-- Logs begin at Thu 2021-11-18 20:22:56 UTC, end at Thu 2021-11-18 21:22:00 UTC. -- Nov 18 20:52:45.289325 dv-cinder-799871-8-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 18 20:52:48.042566 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.common.config [-] Logging enabled! Nov 18 20:52:48.043159 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev211 Nov 18 20:52:48.043346 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102526) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 18 20:52:48.046531 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.common.config [-] Logging enabled! Nov 18 20:52:48.046786 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev211 Nov 18 20:52:48.047098 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=102526) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 18 20:52:48.048022 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 18 20:52:48.048366 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 18 20:52:48.048729 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 18 20:52:48.048973 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 18 20:52:48.049200 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 18 20:52:48.049524 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.049944 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING oslo_config.cfg [-] Deprecated: Option "allow_overlapping_ips" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future. Nov 18 20:52:48.050256 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.050548 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.050836 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.051126 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.051413 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.051691 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.051977 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.052330 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.052619 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.052899 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.053181 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.053473 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.053758 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] config_source = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.054045 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.054333 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.054619 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] debug = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.054902 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.055392 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.056315 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.056634 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.056887 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.057164 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.057438 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.057717 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.058003 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.058333 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] host = dv-cinder-799871-8-iscsi {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.058612 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.058896 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.059180 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.059468 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.059746 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.060027 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.060338 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.060943 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_dir = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.061224 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.061504 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.061796 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.062087 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.062379 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.062607 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.062831 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.063133 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.063421 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.063697 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.063971 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.064277 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.064555 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.064830 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.065101 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.065386 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.065671 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.065956 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.066231 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.066504 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.066776 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.067048 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.067331 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.067602 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.067872 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.068169 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.068458 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.068727 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.069001 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.069301 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.069592 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.069874 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.070159 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.070432 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.070712 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.071011 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.071538 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] use_journal = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.071674 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] use_json = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.071957 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.072253 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.072541 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.072815 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.073089 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.073363 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.073635 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.073917 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:48.074213 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.074510 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.074810 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.075093 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.075397 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.075676 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.075962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.076263 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.076552 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.076841 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.077129 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.077409 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.077696 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.077974 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.078266 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.078572 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.078863 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.079154 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.079428 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.079705 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.079979 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.080282 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.080571 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.080847 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.081132 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.081419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.081696 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.081992 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.082278 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.082614 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.082858 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.083133 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.083415 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.083706 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.083982 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.084282 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.084560 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.084846 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.085121 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.085393 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.085672 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.085946 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.086213 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.086482 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.086836 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.087249 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.087531 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.087805 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.088077 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.088382 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.088652 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.088935 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.089209 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.089480 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.089754 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.090030 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.090298 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.090569 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.090845 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.091114 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.091390 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.091660 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.091929 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.092227 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.092501 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.092770 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.093039 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.093579 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.093852 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.094121 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.094390 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.094660 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.094932 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.095204 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.095487 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.096014 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.096315 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.096593 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.096869 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.097145 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.097421 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.097695 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.097969 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.098241 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.098508 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.098798 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.099075 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.099357 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.099640 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.099936 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.100254 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.100529 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.100807 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.101080 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.101350 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.101628 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.101905 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.102715 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.103188 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.103382 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.103670 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.103958 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.104257 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.104565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.104842 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:48.105056 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 18 20:52:48.105292 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=102526) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 18 20:52:48.529881 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=102526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 18 20:52:48.530083 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=102526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 18 20:52:48.530387 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=102526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Nov 18 20:52:48.530730 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 18 20:52:48.864230 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.864531 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.864801 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.865977 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.866252 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.866514 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.903721 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.904005 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.904297 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.919420 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.919698 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.919963 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.948883 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.949167 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.949431 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.986151 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.986428 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:48.986691 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.241709 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.242315 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.242315 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.242494 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.243653 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.345471 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.345793 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.346077 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.346346 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.346609 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.346917 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.347173 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.347427 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.347678 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.347957 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.348237 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.348499 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.348752 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.349002 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.349255 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.349515 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.349766 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.350029 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.350294 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.350551 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.350821 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.351071 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.351349 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.351723 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.351969 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.352815 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.353301 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:49.353544 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:49.353784 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:49.354024 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:49.354261 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:49.354496 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:49.354854 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 18 20:52:49.357957 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 18 20:52:49.361968 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 18 20:52:49.365818 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(600, 649)])]) Nov 18 20:52:49.367438 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 18 20:52:49.368519 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 18 20:52:49.368857 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 18 20:52:49.369232 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 18 20:52:49.372040 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 18 20:52:49.372312 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 18 20:52:49.372655 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 18 20:52:49.377867 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 18 20:52:49.399760 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 18 20:52:49.400266 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.400566 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=102526) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:89}} Nov 18 20:52:49.401087 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.402482 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=102526) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 18 20:52:49.402766 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 18 20:52:49.403009 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 18 20:52:49.406215 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.406496 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:49.472649 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 18 20:52:49.472889 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 18 20:52:49.473125 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 18 20:52:49.473513 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 18 20:52:49.499950 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_db.sqlalchemy.engines [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=102526) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 18 20:52:50.059635 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing driver for type 'gre' Nov 18 20:52:50.060196 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] gre ID ranges: [(1, 1000)] Nov 18 20:52:50.112547 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing driver for type 'local' Nov 18 20:52:50.112801 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing driver for type 'vlan' Nov 18 20:52:50.126846 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] VlanTypeDriver initialization complete Nov 18 20:52:50.127226 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing driver for type 'vxlan' Nov 18 20:52:50.127714 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] vxlan ID ranges: [(1, 1000)] Nov 18 20:52:50.183987 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing extension driver 'port_security' Nov 18 20:52:50.184387 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.extensions.port_security [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] PortSecurityExtensionDriver initialization complete Nov 18 20:52:50.184726 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing mechanism driver 'openvswitch' Nov 18 20:52:50.185062 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing mechanism driver 'hyperv' Nov 18 20:52:50.191946 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.plugin [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=102526) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:52:50.192816 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.193184 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.193537 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.194071 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=102526) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 20:52:50.194499 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.194851 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.195197 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.195596 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=102526) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 20:52:50.195996 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.196868 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.197246 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.197809 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=102526) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 20:52:50.198219 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > security_group after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.198565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > security_group after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.198908 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > security_group after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.199306 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=102526) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 20:52:50.199704 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.200045 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.200407 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.200802 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=102526) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 20:52:50.201200 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > address_group after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.201540 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > address_group after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.201874 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > address_group after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.202269 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=102526) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 18 20:52:50.202646 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] ML2 OVO RPC backend initialized. {{(pid=102526) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 18 20:52:50.203343 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.203693 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.204133 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.204467 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > networks before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.204811 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.205148 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > ports before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.205486 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.205822 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnets before_response 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.206161 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.206499 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.206832 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.207170 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.207505 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.207838 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.208198 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.208532 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.208864 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > subnet after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.209430 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.plugin [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Modular L2 Plugin initialization complete Nov 18 20:52:50.209758 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading services supported by the core plugin {{(pid=102526) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 18 20:52:50.210081 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.plugins.ml2.managers [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Got port-security extension from driver 'port_security' Nov 18 20:52:50.210539 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.extensions.vlantransparent [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Disabled vlantransparent extension. Nov 18 20:52:50.211021 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=102526) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 18 20:52:50.211335 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: router Nov 18 20:52:50.248031 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_interface before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.248634 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_create 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.248795 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router before_create 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.249156 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.249525 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.249874 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_delete 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.250225 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > floatingip after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.250686 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > floatingip after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.251042 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_create 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.251384 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_update 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.251729 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_update 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.252073 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.252449 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_update 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.252855 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_update 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.253221 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.253554 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.253888 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: subnet after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.254224 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.254569 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > port precommit_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.254910 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_create 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.255244 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.255581 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.255930 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router after_update 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.256295 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_delete 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.256642 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_create 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.257002 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router_interface after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.257340 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_update 55549900 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.257698 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > agent after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.258043 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > agent after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.258381 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > network after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.259979 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Tracking information for resource: router configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:50.260346 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Tracking information for resource: floatingip configured {{(pid=102526) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 18 20:52:50.265236 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.db.l3_agentschedulers_db [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 18 20:52:50.265804 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.266184 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port after_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.266519 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port after_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.266867 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: port after_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.267637 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router before_create 55550100 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.267998 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_delete 55550100 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.268386 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_create 55550100 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.268740 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > router precommit_update 55550100 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.273656 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.provider_configuration [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service providers = [] {{(pid=102526) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 18 20:52:50.274026 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.db.servicetype_db [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=102526) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 18 20:52:50.277691 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.service_base [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=102526) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 20:52:50.278038 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.service_base [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=102526) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 20:52:50.278379 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.service_base [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=102526) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 20:52:50.279266 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.services.service_base [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=102526) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 18 20:52:50.279633 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.services.service_base [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 18 20:52:50.280001 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.280351 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 18 20:52:50.291087 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.291424 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: auto_allocate Nov 18 20:52:50.297231 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: network precommit_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.297599 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: network precommit_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.298107 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.298425 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: tag Nov 18 20:52:50.305140 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.305471 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: timestamp Nov 18 20:52:50.309341 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.309666 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: network_ip_availability Nov 18 20:52:50.315197 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.315567 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.315920 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.316659 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.316976 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: flavors Nov 18 20:52:50.322430 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.322754 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading Plugin: revisions Nov 18 20:52:50.327043 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=102526) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 18 20:52:50.327433 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_concurrency.lockutils [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.797s {{(pid=102526) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Nov 18 20:52:50.328206 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=102526) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 18 20:52:50.328541 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Initializing extension manager. Nov 18 20:52:50.329052 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: __init__.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.329393 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: __pycache__ {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.329725 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.330055 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: address_group.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.330801 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.331366 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: address-group Nov 18 20:52:50.331687 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: address_scope.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.332432 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.332942 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: address-scope Nov 18 20:52:50.333262 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: admin_state_down_before_update.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.334183 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.334697 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: router-admin-state-down-before-update Nov 18 20:52:50.335018 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: agent.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.335710 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.336249 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: agent Nov 18 20:52:50.336567 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: agent_resources_synced.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.338002 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.338502 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: agent-resources-synced Nov 18 20:52:50.338820 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: allowedaddresspairs.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.340607 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.341122 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: allowed-address-pairs Nov 18 20:52:50.341447 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: auto_allocated_topology.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.342513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.343023 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: auto-allocated-topology Nov 18 20:52:50.343602 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: availability_zone.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.344315 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.344821 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: availability_zone Nov 18 20:52:50.345142 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: availability_zone_filter.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.346040 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.346543 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: availability_zone_filter Nov 18 20:52:50.346862 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: data_plane_status.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.347757 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.348278 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension data-plane-status not supported by any of loaded plugins Nov 18 20:52:50.348597 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: default_subnetpools.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.349504 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.350003 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: default-subnetpools Nov 18 20:52:50.350325 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: dhcpagentscheduler.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.351114 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.351612 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: dhcp_agent_scheduler Nov 18 20:52:50.351929 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: dns.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.353012 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.353513 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension dns-integration not supported by any of loaded plugins Nov 18 20:52:50.353828 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: dns_domain_ports.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.354733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.355234 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 18 20:52:50.355551 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.356492 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.356993 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 18 20:52:50.357312 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: dvr.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.357977 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.358477 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: dvr Nov 18 20:52:50.358793 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: ecmp_routes.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.359707 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.360239 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 18 20:52:50.360563 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: empty_string_filtering.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.361495 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.361964 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: empty-string-filtering Nov 18 20:52:50.362284 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.363227 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.363684 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 18 20:52:50.363999 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.364928 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.365434 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 18 20:52:50.365749 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: external_net.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.366647 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.367151 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: external-net Nov 18 20:52:50.367467 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: extra_dhcp_opt.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.368568 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.369076 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: extra_dhcp_opt Nov 18 20:52:50.369392 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: extraroute.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.370292 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.370797 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: extraroute Nov 18 20:52:50.371116 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: extraroute_atomic.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.372527 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.373114 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: extraroute-atomic Nov 18 20:52:50.373474 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: filter_validation.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.374368 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.374907 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: filter-validation Nov 18 20:52:50.375304 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: fip_pf_description.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.376485 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.377165 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 18 20:52:50.377686 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: fip_port_details.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.378918 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.379566 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: fip-port-details Nov 18 20:52:50.379987 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: flavors.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.381346 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.382003 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: flavors Nov 18 20:52:50.382398 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.385341 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.385939 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 18 20:52:50.386308 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: floatingip_pools.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.387078 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.387726 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: floatingip-pools Nov 18 20:52:50.388246 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: ip_allocation.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.389341 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.389915 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension ip_allocation not supported by any of loaded plugins Nov 18 20:52:50.390308 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.391335 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.391918 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: ip-substring-filtering Nov 18 20:52:50.392393 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l2_adjacency.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.393532 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.394101 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 18 20:52:50.394501 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.395772 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.396422 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: router Nov 18 20:52:50.396816 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3_conntrack_helper.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.399254 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.400765 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 18 20:52:50.401165 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.402307 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.403037 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: ext-gw-mode Nov 18 20:52:50.403425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.404758 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.405375 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: l3-ha Nov 18 20:52:50.405760 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3_flavors.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.406892 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.407494 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: l3-flavors Nov 18 20:52:50.407899 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.408920 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.409428 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 18 20:52:50.409748 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: l3agentscheduler.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.410770 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.411274 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: l3_agent_scheduler Nov 18 20:52:50.411598 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: local_ip.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.413507 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.414022 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension local_ip not supported by any of loaded plugins Nov 18 20:52:50.414352 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: logging.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.417412 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.417944 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension logging not supported by any of loaded plugins Nov 18 20:52:50.418282 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: metering.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.419063 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.419646 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: metering Nov 18 20:52:50.419979 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.421114 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.421634 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: metering_source_and_destination_fields Nov 18 20:52:50.421967 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: multiprovidernet.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.422894 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.423410 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: multi-provider Nov 18 20:52:50.423737 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: netmtu.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.424677 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.425189 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: net-mtu Nov 18 20:52:50.425513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: netmtu_writable.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.426426 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.426930 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: net-mtu-writable Nov 18 20:52:50.427282 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: network_availability_zone.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.428001 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.428546 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: network_availability_zone Nov 18 20:52:50.428868 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: network_ip_availability.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.429967 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.430477 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: network-ip-availability Nov 18 20:52:50.431359 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: network_segment_range.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.432275 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.432777 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension network-segment-range not supported by any of loaded plugins Nov 18 20:52:50.433104 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: pagination.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.434085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.434446 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: pagination Nov 18 20:52:50.434767 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: port_device_profile.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.435679 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.436220 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: port-device-profile Nov 18 20:52:50.436544 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.437468 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.437976 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: port-mac-address-regenerate Nov 18 20:52:50.438297 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.439203 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.439711 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: port-numa-affinity-policy Nov 18 20:52:50.440032 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: port_resource_request.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.440955 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.441457 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension port-resource-request not supported by any of loaded plugins Nov 18 20:52:50.441776 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: port_resource_request_groups.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.442721 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.443235 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 18 20:52:50.443557 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: portbindings.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.444504 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.445015 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: binding Nov 18 20:52:50.445336 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: portbindings_extended.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.447247 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.447756 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: binding-extended Nov 18 20:52:50.448136 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: portsecurity.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.449042 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.449549 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: port-security Nov 18 20:52:50.449868 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: project_id.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.450838 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.451164 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: project-id Nov 18 20:52:50.451485 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: providernet.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.452438 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.452954 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: provider Nov 18 20:52:50.453278 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.456925 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.457445 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos not supported by any of loaded plugins Nov 18 20:52:50.457774 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.459019 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.459534 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 18 20:52:50.459862 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.460803 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.461310 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 18 20:52:50.461633 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_default.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.462573 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.463077 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-default not supported by any of loaded plugins Nov 18 20:52:50.463404 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_fip.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.464057 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.464577 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-fip not supported by any of loaded plugins Nov 18 20:52:50.464896 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_gateway_ip.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.465813 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.466321 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 18 20:52:50.466643 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_port_network_policy.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.467547 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.468057 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 18 20:52:50.468655 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.469871 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.470387 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 18 20:52:50.470713 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_pps_rule.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.471898 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.472438 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-pps not supported by any of loaded plugins Nov 18 20:52:50.472766 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_rule_type_details.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.473692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.474202 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 18 20:52:50.474523 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: qos_rules_alias.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.475550 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.476057 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 18 20:52:50.476404 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: quota_check_limit.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.477304 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.478237 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: quota-check-limit Nov 18 20:52:50.478667 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: quotasv2.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.479615 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.479941 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: quotas Nov 18 20:52:50.480290 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: quotasv2_detail.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.483451 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.483790 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: quota_details Nov 18 20:52:50.484138 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: rbac.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.485206 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.485725 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: rbac-policies Nov 18 20:52:50.486056 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: rbac_address_group.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.486974 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.487491 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: rbac-address-group Nov 18 20:52:50.487817 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: rbac_address_scope.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.488767 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.489279 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: rbac-address-scope Nov 18 20:52:50.489600 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: rbac_security_groups.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.490515 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.491023 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: rbac-security-groups Nov 18 20:52:50.491352 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: rbac_subnetpool.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.492345 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.492853 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: rbac-subnetpool Nov 18 20:52:50.493173 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: revisionifmatch.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.494618 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.495123 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: revision-if-match Nov 18 20:52:50.495444 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: revisions.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.496568 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.497072 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: standard-attr-revisions Nov 18 20:52:50.497391 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: router_availability_zone.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.498052 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.498556 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: router_availability_zone Nov 18 20:52:50.498876 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: routerservicetype.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.499782 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.500309 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension router-service-type not supported by any of loaded plugins Nov 18 20:52:50.500633 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.501626 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.502136 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: security-groups-normalized-cidr Nov 18 20:52:50.502461 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: security_groups_port_filtering.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.503377 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.503885 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: port-security-groups-filtering Nov 18 20:52:50.504239 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.505158 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.505668 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: security-groups-remote-address-group Nov 18 20:52:50.505989 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.506914 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.507418 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: security-groups-shared-filtering Nov 18 20:52:50.507739 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.508344 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 18 20:52:50.508663 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: securitygroup.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.519291 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.519813 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: security-group Nov 18 20:52:50.520175 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: segment.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.520957 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.521462 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension segment not supported by any of loaded plugins Nov 18 20:52:50.521788 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.522735 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.523247 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 18 20:52:50.523569 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: servicetype.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.524820 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.525378 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: service-type Nov 18 20:52:50.525704 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: sorting.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.526675 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.527006 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: sorting Nov 18 20:52:50.527329 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: standard_attr_segment.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.528273 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.528781 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 18 20:52:50.529103 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: standardattrdescription.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.529750 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.530250 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: standard-attr-description Nov 18 20:52:50.530570 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: stateful_security_group.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.531494 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.531999 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: stateful-security-group Nov 18 20:52:50.532353 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: stdattrs_common.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.532921 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 18 20:52:50.533245 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.534169 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.534679 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 18 20:52:50.534997 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: subnet_onboard.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.536057 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.536604 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: subnet_onboard Nov 18 20:52:50.536927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.537849 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.538357 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 18 20:52:50.538682 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: subnet_service_types.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.539613 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.540159 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: subnet-service-types Nov 18 20:52:50.540486 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: subnetallocation.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.541696 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.542202 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: subnet_allocation Nov 18 20:52:50.542526 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.543181 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.543683 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: subnetpool-prefix-ops Nov 18 20:52:50.544001 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.544947 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.545454 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 18 20:52:50.545776 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: tagging.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.546844 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.547347 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: standard-attr-tag Nov 18 20:52:50.547674 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: timestamp.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.548894 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.549414 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loaded extension: standard-attr-timestamp Nov 18 20:52:50.549735 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: trunk.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.550764 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.551276 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension trunk not supported by any of loaded plugins Nov 18 20:52:50.551599 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: trunk_details.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.552558 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.553072 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension trunk-details not supported by any of loaded plugins Nov 18 20:52:50.553393 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: uplink_status_propagation.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.554303 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.554813 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 18 20:52:50.555133 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Loading extension file: vlantransparent.py {{(pid=102526) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 18 20:52:50.556553 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=102526) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 18 20:52:50.557082 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 18 20:52:50.559555 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:network Nov 18 20:52:50.560081 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:subnet Nov 18 20:52:50.560502 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 20:52:50.560892 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:port Nov 18 20:52:50.562102 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.562543 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service FLAVORS assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.563159 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.563585 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.563919 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:router Nov 18 20:52:50.564383 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:floatingip Nov 18 20:52:50.564864 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service METERING assigned prefix: /metering {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.566298 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.566665 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.567014 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=102526) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 20:52:50.568002 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of CountableResource for resource:rbac_policy Nov 18 20:52:50.568499 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:security_group Nov 18 20:52:50.568962 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 18 20:52:50.569557 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service CORE assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.569889 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 20:52:50.570233 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] subnetpool is already registered Nov 18 20:52:50.570656 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service CORE assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.570980 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 20:52:50.571308 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] subnetpool is already registered Nov 18 20:52:50.574398 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.574827 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service FLAVORS assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.575406 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.576034 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.576472 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:router Nov 18 20:52:50.576813 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] router is already registered Nov 18 20:52:50.577222 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:floatingip Nov 18 20:52:50.577751 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] floatingip is already registered Nov 18 20:52:50.578277 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service METERING assigned prefix: /metering {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.578941 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of CountableResource for resource:rbac_policy Nov 18 20:52:50.579299 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] rbac_policy is already registered Nov 18 20:52:50.579827 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:security_group Nov 18 20:52:50.580177 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] security_group is already registered Nov 18 20:52:50.580578 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 18 20:52:50.580906 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] security_group_rule is already registered Nov 18 20:52:50.581525 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service CORE assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.581851 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 20:52:50.582180 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] subnetpool is already registered Nov 18 20:52:50.582598 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.v2.resource_helper [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Service CORE assigned prefix: {{(pid=102526) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 18 20:52:50.582914 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Creating instance of TrackedResource for resource:subnetpool Nov 18 20:52:50.583241 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING neutron.quota.resource_registry [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] subnetpool is already registered Nov 18 20:52:50.583706 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: extensions {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.585180 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: address-groups {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.586652 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: address-scopes {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.588583 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: agents {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.589816 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: auto-allocated-topology {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.591040 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: availability_zones {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.592279 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: dhcp-networks {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.594047 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: dhcp-agents {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.595835 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: routers {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.598078 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: flavors {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.599238 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: service_profiles {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.600465 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: next_providers {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.601902 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: service_profiles {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.605559 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: floatingip-pools {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.606770 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: routers {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.608903 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: floatingips {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.611174 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: l3-routers {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.612606 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: l3-agents {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.614051 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: metering-labels {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.615450 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: metering-label-rules {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.616997 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: network-ip-availabilities {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.618314 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: bindings {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.620051 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: quotas {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.621616 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: quotas {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.623154 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: rbac-policies {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.624466 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: security-groups {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.625696 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: security-group-rules {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.626922 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: service-providers {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.628144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: subnetpools {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.629573 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: subnetpools {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.631028 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.632755 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.634582 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.636373 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.638156 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.640009 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.641713 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.643613 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.645394 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.647238 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron.api.extensions [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Extended resource: tags {{(pid=102526) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 18 20:52:50.653860 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING keystonemiddleware.auth_token [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 18 20:52:50.658524 dv-cinder-799871-8-iscsi neutron-server[102526]: WARNING keystonemiddleware.auth_token [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 18 20:52:50.667960 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_concurrency.lockutils [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Acquired lock "singleton_lock" {{(pid=102526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Nov 18 20:52:50.668452 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_concurrency.lockutils [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Releasing lock "singleton_lock" {{(pid=102526) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Nov 18 20:52:50.669096 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Starting 2 workers Nov 18 20:52:50.673891 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Started child 102669 {{(pid=102526) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 20:52:50.678236 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Started child 102670 {{(pid=102526) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 20:52:50.679530 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:52:50.680210 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO neutron.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 18 20:52:50.680413 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Publish callbacks [] for process, before_spawn {{(pid=102526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:52:50.681064 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [-] (102669) wsgi starting up on http://0.0.0.0:9696 Nov 18 20:52:50.683174 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Starting 1 workers Nov 18 20:52:50.683442 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:52:50.684813 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [-] (102670) wsgi starting up on http://0.0.0.0:9696 Nov 18 20:52:50.688348 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Started child 102671 {{(pid=102526) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 20:52:50.688904 dv-cinder-799871-8-iscsi neutron-server[102526]: INFO oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Starting 1 workers Nov 18 20:52:50.692180 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] calling RpcWorker wait() {{(pid=102671) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 18 20:52:50.692700 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] returning from RpcWorker wait() {{(pid=102671) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 18 20:52:50.693279 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Started child 102672 {{(pid=102526) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 18 20:52:50.694095 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG neutron_lib.callbacks.manager [None req-bcaf73b0-2c54-4784-9a4e-d162f22f7f51 None None] Publish callbacks [] for process, after_spawn {{(pid=102526) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:52:50.694210 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:52:50.694553 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:52:50.696009 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102526) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 18 20:52:50.696237 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 18 20:52:50.696473 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 18 20:52:50.696711 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 18 20:52:50.697022 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 18 20:52:50.697199 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 18 20:52:50.697703 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.697961 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.698213 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.698457 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.698751 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.699309 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.699406 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:52:50.699865 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.699865 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.700071 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.700334 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.700508 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.700672 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.700758 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:52:50.700922 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.701177 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.701482 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.701758 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.701992 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.702233 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.702401 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.702636 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.702912 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.703158 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.703417 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] debug = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.703666 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.704252 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.704478 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.704735 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.704967 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.705235 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.705486 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.705753 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.706005 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.706223 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.706475 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.706720 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.706953 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.707180 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.707421 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.707635 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.707887 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.708090 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.708588 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] host = dv-cinder-799871-8-iscsi {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.708809 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.709031 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.709267 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.709520 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.709780 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.709974 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.710229 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.710497 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.710725 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.710946 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.711222 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.711429 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.711649 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.711900 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.712639 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_options = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.713091 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.713364 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.713621 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.713823 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.713991 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.714175 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.714434 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.714598 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.714859 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.715106 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.715318 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.715547 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.715788 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.716022 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.716295 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.716542 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.716761 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.716970 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.717233 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.717458 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.717974 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.718220 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.718717 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.718939 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.719152 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.719373 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.719605 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.719903 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.720037 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.720308 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.720539 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.720791 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.721004 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.721249 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.721506 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.721733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.721957 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.722184 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.722440 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.722663 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.722916 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.723158 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.723368 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.723625 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.723851 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.724080 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.724348 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_json = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.724556 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.724803 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.725062 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.725271 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.725483 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.725698 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.726639 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.726639 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.728831 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.729264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.729616 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.729910 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.730201 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.730607 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.730714 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.730914 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.731206 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.731470 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.731772 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.732023 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.733032 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.733260 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.734162 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.734529 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.734897 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.735202 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.736449 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.736449 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.736449 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.736449 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737043 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737043 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737043 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737453 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737453 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737721 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.737956 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.738872 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.738872 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.738872 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.61/identity {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.740692 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.742945 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.745085 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.747144 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.749264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.752565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753105 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753630 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753630 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753630 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.753806 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.754024 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.754257 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.754477 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.754713 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.754944 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.755198 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.755419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.755642 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.755880 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.756097 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757135 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757135 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757135 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757135 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757686 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757686 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757995 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.757995 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.758329 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.758530 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.758717 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.758972 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.759228 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.759624 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.759785 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.760038 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.760344 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.760629 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.760912 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.761155 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.761396 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.761660 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.761917 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.762201 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.762438 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.762681 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.762901 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.763147 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.763463 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.763629 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.763853 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.764141 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.764376 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.764587 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.764798 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.765053 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.765294 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.765770 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.765919 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.766056 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.766288 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.766868 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.766868 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.61/identity {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.767146 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.767286 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768675 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768675 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.768878 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.769076 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.769407 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.769625 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.769868 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.770082 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.770295 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.770551 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.770759 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.772385 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773095 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773095 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773095 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773381 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773463 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773700 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.773974 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.774182 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.774435 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.775193 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.775409 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.775815 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.776232 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.776621 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.777054 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.777330 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.777498 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.777757 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.778023 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.778370 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.778620 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.778847 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.779090 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.779304 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.779550 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.779787 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.780026 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.780267 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.780486 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.780701 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.780947 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.781188 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.781441 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783928 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783928 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783928 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.783928 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.784593 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.784593 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.784593 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.784899 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.784899 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.785121 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.786733 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.787258 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.787258 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.787258 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.787451 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.787596 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.787818 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.788033 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.788265 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.788485 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.788699 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.788907 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.789155 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.789363 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.789567 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.789783 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.789997 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.790243 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.791072 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.791330 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.791546 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.791836 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.792090 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.792361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.792613 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.792916 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.793132 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.793374 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.793590 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.793824 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.794040 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.794292 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.794616 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.794891 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.795134 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.795369 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.795646 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.795922 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.796235 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.796456 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.796759 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.797093 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.797386 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.797637 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.797864 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.798165 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.798388 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.798605 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.798856 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.799113 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.799345 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.799582 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.799828 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.800077 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.800312 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.800540 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.800754 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.801008 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.801215 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.801453 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.801683 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.801840 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 18 20:52:50.802354 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=102526) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 18 20:52:50.802498 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 18 20:52:50.802655 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 18 20:52:50.802822 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 18 20:52:50.802990 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 18 20:52:50.803143 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 18 20:52:50.803349 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.803510 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.803675 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.803810 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.803971 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.804167 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.804329 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.804486 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.804645 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.804800 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.804958 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.805115 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.805272 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.805418 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.806493 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.806493 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.806493 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.806493 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.806493 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.806493 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] config_source = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] debug = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807419 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807794 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807794 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.807954 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.808032 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.808164 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.808324 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.808480 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] fatal_deprecations = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.810927 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] host = dv-cinder-799871-8-iscsi {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.811756 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_dir = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.812857 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_options = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.813513 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.814962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815300 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815300 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815534 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815534 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815761 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815761 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.815952 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.816056 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.816235 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.816393 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.816550 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.816707 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.816866 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817024 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817181 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817340 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817499 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817657 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817816 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.817980 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.818137 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.818294 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.818451 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.818609 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.818766 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.818924 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.819081 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_journal = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.819240 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_json = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.819396 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.819712 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.819870 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.820014 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.820166 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.820330 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.820487 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.820646 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 18 20:52:50.820827 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.820990 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.821160 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.821320 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822057 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822225 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822509 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822646 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822789 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.822934 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823064 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823198 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823332 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823465 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823632 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823791 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.823951 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.824150 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.824309 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.824453 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.824594 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.824725 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.824860 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825001 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825163 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825371 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825506 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825646 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825785 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.825916 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.826080 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.61/identity {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.826240 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.826398 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.826558 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.826721 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.826867 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827027 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827187 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827347 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827507 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827667 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827826 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.827984 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.828162 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.828328 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.828488 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.828649 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.828811 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.828973 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.829133 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.829293 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.829454 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.829614 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.829774 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.829934 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.830092 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.830262 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.830421 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.830580 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.830739 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.830900 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831060 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831219 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831378 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831525 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831684 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831827 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.831999 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.832165 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.832330 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.832488 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.832647 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.832806 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.832964 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.833124 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.833283 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.833441 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.833599 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.833758 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.833916 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834076 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834235 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834396 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834987 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834987 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834987 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.834987 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.835370 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.835370 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.835565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.835687 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.835767 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.835891 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.836045 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.836224 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.836366 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.836529 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.836688 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.836848 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.837653 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.837852 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.838016 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.838343 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.838514 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.838675 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.838834 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.838992 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.839151 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.839311 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.839457 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:52:50.839559 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.839640 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.839763 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.839923 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.840082 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.840266 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.840425 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.840583 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.840750 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.840909 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.841070 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.841230 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.841394 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.841564 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.841725 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.841885 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.842044 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.842203 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.842363 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.842522 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.842681 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.842840 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.843000 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.843159 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.843594 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.843754 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.843919 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.844077 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.844290 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.844448 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.844606 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.844799 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.844923 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.845082 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.845241 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.845401 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.845560 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.845719 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.845879 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.846037 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.61/identity {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.846198 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.846357 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.846516 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.846684 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.846861 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847014 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847150 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847294 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847428 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847582 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847742 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.847902 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.848061 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.848232 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.848377 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.848538 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.848686 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.848846 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.849006 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.849166 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.849326 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.849484 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.849642 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.849881 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.850086 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.850264 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.850440 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.850631 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.850631 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.850897 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851068 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851068 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851669 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851669 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851669 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851957 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.851957 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.852099 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.852249 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.852400 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.852561 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.852752 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.853072 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.853246 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.853406 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.853565 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.853725 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.853884 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.854043 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.854409 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.854409 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.854570 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.854658 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.854799 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855012 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855112 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855268 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855426 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855582 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855743 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.855902 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.856061 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.856401 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.856401 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.856553 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.856711 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.856871 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857032 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857202 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857361 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857520 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857679 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857838 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.857997 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.858165 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.858325 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.858484 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.858647 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.858804 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.858964 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.859130 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.859289 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.859448 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.859605 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.859765 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.859923 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.860090 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.860270 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.860431 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.860590 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.860748 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.860908 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.861076 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.861235 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.861397 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.861556 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.861714 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.861871 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.862039 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.862201 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.862358 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.862519 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.862677 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.862835 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.863014 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.863163 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.863326 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864187 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864187 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864187 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864187 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864187 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864785 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.864969 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.865145 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.865309 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.865479 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.865649 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:600:649'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.865818 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.865979 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.866145 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.866621 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.866621 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.866621 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.866914 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.866914 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.867062 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.867202 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.867359 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.867666 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.867827 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.867988 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.868172 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.868452 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.868631 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.868828 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.868962 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.869123 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.869283 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.869444 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.869604 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 18 20:52:50.869758 dv-cinder-799871-8-iscsi neutron-server[102526]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=102526) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 18 20:52:50.968770 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 58940) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:52:50.977338 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [-] 10.222.0.61 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0064037 Nov 18 20:53:02.307261 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8ecef4fe-461b-4a62-b5e5-f2a940692b16 None None] get_active_networks_info from dv-cinder-799871-8-iscsi {{(pid=102671) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 18 20:53:02.340778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9243387d-8a20-498b-9a4f-52743d1cbdff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1015779'] for agent, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:02.384344 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8ecef4fe-461b-4a62-b5e5-f2a940692b16 None None] No non-hosted networks {{(pid=102671) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 18 20:53:04.605634 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f1b9690f-cfd2-483d-8273-30e92db6f514 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1015779'] for agent, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:04.663919 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8b698c57-32ef-4906-97ca-0136c02e341d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:06.009282 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1015779'] for agent, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:07.456036 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1015779'] for agent, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:07.646587 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.db.l3_hamode_db [None req-a6961948-d6b3-4082-a303-dba6ec7e26a6 None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 18 20:53:07.724024 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6961948-d6b3-4082-a303-dba6ec7e26a6 None None] Routers set() bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 20:53:07.724591 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a6961948-d6b3-4082-a303-dba6ec7e26a6 None None] Router IDs set() for agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 18 20:53:08.218514 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1015779'] for agent, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:08.219452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.220019 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.221052 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.221416 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.221921 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.222338 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.222665 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.223028 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.223358 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.223680 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.224228 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.224777 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:08.225182 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-799871-8-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:08.231651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-799871-8-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:08.634166 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59030) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:09.140901 dv-cinder-799871-8-iscsi neutron-server[102670]: WARNING oslo_policy.policy [None req-5ce10806-2555-4b0c-ba1d-56001de22404 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:53:09.141456 dv-cinder-799871-8-iscsi neutron-server[102670]: WARNING oslo_policy.policy [None req-5ce10806-2555-4b0c-ba1d-56001de22404 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:53:09.367674 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [None req-5ce10806-2555-4b0c-ba1d-56001de22404 admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 20:53:09.369638 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-5ce10806-2555-4b0c-ba1d-56001de22404 admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.7333477 Nov 18 20:53:11.910032 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59046) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:12.397078 dv-cinder-799871-8-iscsi neutron-server[102669]: WARNING oslo_policy.policy [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:53:12.397670 dv-cinder-799871-8-iscsi neutron-server[102669]: WARNING oslo_policy.policy [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:53:12.619739 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] Request body: {'subnetpool': {'name': 'shared-default-subnetpool-v4', 'default_prefixlen': 26, 'prefixes': ['172.20.0.0/16'], 'shared': True, 'is_default': True}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:12.715029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.policy [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102669) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 18 20:53:12.762431 dv-cinder-799871-8-iscsi neutron-server[102669]: WARNING oslo_policy.policy [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:53:12.762796 dv-cinder-799871-8-iscsi neutron-server[102669]: WARNING oslo_policy.policy [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:53:12.771239 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.quota [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] Loaded quota_driver: . Nov 18 20:53:12.861080 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748167509703', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748167509176', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748167512485', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748167527849', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748167465759', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8748167476240', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-1644470', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1863022', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-862535', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-657049'] for rbac-policy, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:12.926468 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:12.927853 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-93493c6e-0f15-40e0-bc7b-bcbf6f70473b admin admin] 10.222.0.61 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.0157440 Nov 18 20:53:15.615043 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59064) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:15.918594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Request body: {'network': {'name': 'private', 'admin_state_up': True, 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:15.947699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Made reservation on behalf of fa9679221f8241b2bbfa57a841d6f0db for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 20:53:15.950536 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:15.966627 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.078269 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.082101 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.101647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 619} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 20:53:16.129922 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8748165505383', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.130571 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Unsubscribe: segment precommit_create {{(pid=102669) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 18 20:53:16.131083 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Added segment ed073cc9-f366-47ea-8658-f504d36a9812 of type vlan for network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 Nov 18 20:53:16.149386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1947a005-1ed1-4f38-9c0f-6fa82d61ddd4,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:16.200065 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.200445 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.200783 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.201115 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.201433 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.201769 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.202088 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.202417 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.202749 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.203061 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.203374 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.203682 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Tracked resource versions report: Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: pushed versions: Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: { 'AddressGroup': {'1.2'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'ConntrackHelper': {'1.0'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Log': {'1.0'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Network': {'1.1'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Port': {'1.7'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'PortForwarding': {'1.2'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'QosPolicy': {'1.10'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroup': {'1.5'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroupRule': {'1.2'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SubPort': {'1.0'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Subnet': {'1.1'}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Trunk': {'1.1'}} Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: consumer versions: Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'ConntrackHelper': '1.0', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Log': '1.0', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Network': '1.1', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Port': '1.7', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'PortForwarding': '1.2', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'QosPolicy': '1.10', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroup': '1.5', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroupRule': '1.2', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SubPort': '1.0', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Subnet': '1.1', Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Trunk': '1.1'}} Nov 18 20:53:16.204737 dv-cinder-799871-8-iscsi neutron-server[102669]: {{(pid=102669) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 20:53:16.246003 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.287513 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.288700 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:16.289399 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:16.370171 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 0.7539866 Nov 18 20:53:16.394593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e38ed4c0-fab6-44d9-83d7-b78aee18e253 admin admin] Pushing event updated for resources: {'Network': ['ID=c9bb1884-bd7e-489c-b6ac-0e5095cbd555,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:16.407894 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 20:53:19.142928 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59078) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:19.553140 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-68e8bfc5-2826-4d25-aea2-ad7146a547a2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:19.554571 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-68e8bfc5-2826-4d25-aea2-ad7146a547a2 admin admin] 10.222.0.61 "GET /v2.0/networks/c9bb1884-bd7e-489c-b6ac-0e5095cbd555 HTTP/1.1" status: 200 len: 825 time: 0.4106650 Nov 18 20:53:19.581473 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-486eca3a-6769-4212-a59a-6797d7b01679 admin admin] 10.222.0.61 "GET /v2.0/subnetpools/7eb001ce-ab3b-4b22-9942-8b3c2fc3c398 HTTP/1.1" status: 200 len: 734 time: 0.0200503 Nov 18 20:53:19.591110 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Request body: {'subnet': {'name': 'private-subnet', 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398', 'gateway_ip': '172.20.0.1', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'ip_version': 4, 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:19.616625 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Made reservation on behalf of fa9679221f8241b2bbfa57a841d6f0db for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 20:53:19.619416 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:19.967440 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:20.043517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Pushing event updated for resources: {'Subnet': ['ID=1de83f46-0770-463e-8125-f93dabbe17b0,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:20.045810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Checking segment: {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:53:20.046221 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Network hostable DHCP agents. Network: c9bb1884-bd7e-489c-b6ac-0e5095cbd555, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 20:53:20.070906 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 20:53:20.088070 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, c9bb1884-bd7e-489c-b6ac-0e5095cbd555) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:53:20.094246 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:20.095168 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:20.098245 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-dc43d55d-0dc2-412c-86e6-a8051e0cb8f8 None None] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:53:20.115401 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-fdefe326-19c0-4844-8ca6-197a4cab9659 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.5275302 Nov 18 20:53:20.463121 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 20:53:20.464395 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:20.776616 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Allocated IP 172.20.0.2 (c9bb1884-bd7e-489c-b6ac-0e5095cbd555/1de83f46-0770-463e-8125-f93dabbe17b0/c67d8d04-d530-4192-85bc-dee249725c44) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 20:53:21.002801 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:21.012093 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:21.093776 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 20:53:21.101680 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:53:21.104895 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Pushing event updated for resources: {'Port': ['ID=c67d8d04-d530-4192-85bc-dee249725c44,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:21.107001 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 20:53:21.119912 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.120298 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.120641 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.120976 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.121304 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.121629 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.121956 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.122278 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.122614 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.122936 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.123255 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.123572 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Tracked resource versions report: Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: pushed versions: Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: { 'AddressGroup': {'1.2'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'ConntrackHelper': {'1.0'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Log': {'1.0'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Network': {'1.1'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Port': {'1.7'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'PortForwarding': {'1.2'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'QosPolicy': {'1.10'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroup': {'1.5'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroupRule': {'1.2'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SubPort': {'1.0'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Subnet': {'1.1'}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Trunk': {'1.1'}} Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: consumer versions: Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'ConntrackHelper': '1.0', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Log': '1.0', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Network': '1.1', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Port': '1.7', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'PortForwarding': '1.2', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'QosPolicy': '1.10', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroup': '1.5', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroupRule': '1.2', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SubPort': '1.0', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Subnet': '1.1', Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Trunk': '1.1'}} Nov 18 20:53:21.124627 dv-cinder-799871-8-iscsi neutron-server[102671]: {{(pid=102671) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 20:53:21.196920 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Attempting to bind port c67d8d04-d530-4192-85bc-dee249725c44 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 20:53:21.197316 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Attempting to bind port c67d8d04-d530-4192-85bc-dee249725c44 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 20:53:21.197846 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Attempting to bind port c67d8d04-d530-4192-85bc-dee249725c44 on network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 20:53:21.202932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 20, 53, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 20:53:21.203317 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Checking segment: {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:53:21.203785 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:21.204203 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Bound using segment: {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 20:53:21.204714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Bound port: c67d8d04-d530-4192-85bc-dee249725c44, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 20:53:21.205120 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:21.273628 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] For port c67d8d04-d530-4192-85bc-dee249725c44, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 20:53:21.277953 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] For port c67d8d04-d530-4192-85bc-dee249725c44, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=c67d8d04-d530-4192-85bc-dee249725c44,segment=NetworkSegment(ed073cc9-f366-47ea-8658-f504d36a9812),segment_id=ed073cc9-f366-47ea-8658-f504d36a9812)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 20:53:21.282387 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:21.351301 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22753710-6d6e-4fab-86ae-df605391e83e None None] Pushing event updated for resources: {'Port': ['ID=c67d8d04-d530-4192-85bc-dee249725c44,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:22.699422 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59086) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:23.013723 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [None req-3a3b02ca-d70c-4a12-af59-61e32c6b887b admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 20:53:23.014807 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3a3b02ca-d70c-4a12-af59-61e32c6b887b admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3144174 Nov 18 20:53:25.567767 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59094) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:25.886545 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [None req-d82de669-1b9b-4fe0-af3f-f95ed39d1cd3 admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 20:53:25.887607 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-d82de669-1b9b-4fe0-af3f-f95ed39d1cd3 admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3188179 Nov 18 20:53:28.625128 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59104) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:28.924711 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:28.948659 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:28.950154 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:29.080855 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:29.085898 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:29.100375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:29.101637 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a0539584-4faa-4898-a39e-5c36e54d0498 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.4753575 Nov 18 20:53:29.986007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device c67d8d04-d530-4192-85bc-dee249725c44 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:53:30.078029 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port c67d8d04-d530-4192-85bc-dee249725c44 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:30.078424 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:30.189564 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:30.230989 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port c67d8d04-d530-4192-85bc-dee249725c44, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=c67d8d04-d530-4192-85bc-dee249725c44,segment=NetworkSegment(ed073cc9-f366-47ea-8658-f504d36a9812),segment_id=ed073cc9-f366-47ea-8658-f504d36a9812)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 20:53:30.235109 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:30.285571 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=c67d8d04-d530-4192-85bc-dee249725c44,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:30.462785 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f1ed24bd-65b2-46bf-b17c-06b060bc1f8e None None] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:53:30.523803 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-1e853cf3-f5d9-4812-9094-29a9cacfb9ae None None] Provisioning complete for port c67d8d04-d530-4192-85bc-dee249725c44 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:30.524739 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1e853cf3-f5d9-4812-9094-29a9cacfb9ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:30.883102 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-77a82a1f-26fb-4d7e-b459-658bd00e384e None None] Provisioning complete for port c67d8d04-d530-4192-85bc-dee249725c44 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:30.884188 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-77a82a1f-26fb-4d7e-b459-658bd00e384e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:31.644309 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59116) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:31.958394 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [None req-29fe4137-d656-4059-a723-5fd6a9d45edd admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 20:53:31.959395 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-29fe4137-d656-4059-a723-5fd6a9d45edd admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.3141472 Nov 18 20:53:31.974907 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device c67d8d04-d530-4192-85bc-dee249725c44 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:53:32.025792 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port c67d8d04-d530-4192-85bc-dee249725c44 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:32.026071 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:32.150007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1ea37e8e-3245-4863-9f19-296c135581a4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.443340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59124) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:34.589180 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0dabf048-2da1-41e2-b23b-0cb6bd39b988 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.757429 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Request body: {'network': {'admin_state_up': True, 'name': 'public', 'provider:network_type': 'flat', 'provider:physical_network': 'physnet1', 'router:external': True, 'is_default': True}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:34.780340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Made reservation on behalf of 2069cde52ea54eb0bcf29170115b508e for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 20:53:34.782622 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.791593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.864995 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.868262 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.885239 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Reserving flat network on physical network physnet1 {{(pid=102669) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 18 20:53:34.903289 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1a8b4dec-265f-4987-bdc2-a6f536a9c6f1,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:34.907802 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.908162 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Added segment bc9325a4-1103-4504-96f0-c02c30f29de6 of type flat for network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 Nov 18 20:53:34.953178 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.983778 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:34.984712 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:34.985283 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:35.038337 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5939608 Nov 18 20:53:35.043421 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6acb1436-88bd-42c6-9408-8d76178dd341 admin admin] Pushing event updated for resources: {'Network': ['ID=3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:35.062051 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 20:53:35.924172 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:37.378177 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:37.546959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59142) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:37.721550 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c9482cd7-029b-4fb1-84e5-5050d2dfc1fd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:37.722866 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c9482cd7-029b-4fb1-84e5-5050d2dfc1fd admin admin] 10.222.0.61 "GET /v2.0/subnets/1de83f46-0770-463e-8125-f93dabbe17b0 HTTP/1.1" status: 200 len: 849 time: 0.1749299 Nov 18 20:53:37.837927 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-145531fb-d1e4-4262-a4b5-88d339390721 admin admin] 10.222.0.61 "GET /v2.0/routers/0541b491-b4f8-4eab-bf1b-95c62f407121 HTTP/1.1" status: 200 len: 704 time: 0.1088388 Nov 18 20:53:38.101332 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:38.215952 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:38.391569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Allocated IP 172.20.0.1 (c9bb1884-bd7e-489c-b6ac-0e5095cbd555/1de83f46-0770-463e-8125-f93dabbe17b0/257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 20:53:38.589856 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:38.658042 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:38.729278 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 20:53:38.733974 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:53:38.736495 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 20:53:38.737100 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:38.800966 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Pushing event updated for resources: {'Port': ['ID=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:38.924679 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-d5e52226-85a4-4128-b83b-be1e4fb28027 None None] Provisioning complete for port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:38.925240 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d5e52226-85a4-4128-b83b-be1e4fb28027 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:38.948967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:39.002196 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-d5e52226-85a4-4128-b83b-be1e4fb28027 None None] Port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 20:53:39.158763 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:39.162998 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:39.163898 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:39.243495 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Pushing event updated for resources: {'Port': ['ID=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:39.291036 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 20:53:39.292329 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:53:39.453917 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Router 0541b491-b4f8-4eab-bf1b-95c62f407121 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102669) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 20:53:39.523101 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-7e320fd2-2c1a-4492-8471-76fb992ee8a6 None None] Provisioning complete for port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:39.523466 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e320fd2-2c1a-4492-8471-76fb992ee8a6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:39.546466 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 20:53:39.568794 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-acf3e2f3-10c3-4ef3-9b41-e2829518c28b admin admin] 10.222.0.61 "PUT /v2.0/routers/0541b491-b4f8-4eab-bf1b-95c62f407121/add_router_interface HTTP/1.1" status: 200 len: 508 time: 1.7082629 Nov 18 20:53:39.568892 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Sync routers for ids ['0541b491-b4f8-4eab-bf1b-95c62f407121'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 20:53:39.569325 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-7e320fd2-2c1a-4492-8471-76fb992ee8a6 None None] Port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 20:53:39.571324 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Routers {'0541b491-b4f8-4eab-bf1b-95c62f407121'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 20:53:39.573551 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T20:53:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['0541b491-b4f8-4eab-bf1b-95c62f407121'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:39.780608 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Set router 0541b491-b4f8-4eab-bf1b-95c62f407121 gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 20:53:40.217375 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T20:53:28Z', 'updated_at': '2021-11-18T20:53:38Z', 'revision_number': 2, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'gw_port_host': None, '_interfaces': [{'id': '257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5', 'name': '', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'mac_address': 'fa:16:3e:30:d0:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:38Z', 'updated_at': '2021-11-18T20:53:39Z', 'revision_number': 2, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'subnets': [{'id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:40.268994 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Checking router: 0541b491-b4f8-4eab-bf1b-95c62f407121 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 20:53:40.269368 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Updating router 0541b491-b4f8-4eab-bf1b-95c62f407121 port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 20:53:40.320755 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:40.848734 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:40.855645 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.028287 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Pushing event updated for resources: {'Port': ['ID=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:41.030770 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Attempting to bind port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 20:53:41.031076 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Attempting to bind port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 20:53:41.031508 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Attempting to bind port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 on network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 20:53:41.042107 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.042477 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.042818 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.043151 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.043477 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.043800 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.044145 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.044462 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.044797 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.045118 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.045434 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.045747 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Tracked resource versions report: Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: pushed versions: Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: { 'AddressGroup': {'1.2'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'ConntrackHelper': {'1.0'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Log': {'1.0'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Network': {'1.1'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Port': {'1.7'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'PortForwarding': {'1.2'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'QosPolicy': {'1.10'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroup': {'1.5'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroupRule': {'1.2'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SubPort': {'1.0'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Subnet': {'1.1'}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Trunk': {'1.1'}} Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: consumer versions: Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'ConntrackHelper': '1.0', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Log': '1.0', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Network': '1.1', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Port': '1.7', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'PortForwarding': '1.2', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'QosPolicy': '1.10', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroup': '1.5', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroupRule': '1.2', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SubPort': '1.0', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Subnet': '1.1', Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Trunk': '1.1'}} Nov 18 20:53:41.046781 dv-cinder-799871-8-iscsi neutron-server[102672]: {{(pid=102672) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 20:53:41.049349 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 20, 53, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 20:53:41.049604 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Checking segment: {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:53:41.050061 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.050447 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Bound using segment: {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 20:53:41.050947 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Bound port: 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ed073cc9-f366-47ea-8658-f504d36a9812', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 619, 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 20:53:41.051337 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.104287 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-83fa1fcd-d3aa-446a-ae51-d774deaef99f None None] Provisioning complete for port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:41.104819 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-83fa1fcd-d3aa-446a-ae51-d774deaef99f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.120485 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] For port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 20:53:41.143620 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] For port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,segment=NetworkSegment(ed073cc9-f366-47ea-8658-f504d36a9812),segment_id=ed073cc9-f366-47ea-8658-f504d36a9812)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 20:53:41.143854 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-83fa1fcd-d3aa-446a-ae51-d774deaef99f None None] Port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 20:53:41.149737 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.207591 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Routers {'0541b491-b4f8-4eab-bf1b-95c62f407121'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 20:53:41.208333 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T20:53:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['0541b491-b4f8-4eab-bf1b-95c62f407121'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:41.243694 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-551b31ad-f1dc-44ec-aea4-e70e0a2cec6b None None] Pushing event updated for resources: {'Port': ['ID=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,revision_number=4']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:41.303319 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] Set router 0541b491-b4f8-4eab-bf1b-95c62f407121 gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 20:53:41.464577 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-02498c74-ac94-4c3b-be50-bbc37b446484 None None] Provisioning complete for port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:41.464862 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02498c74-ac94-4c3b-be50-bbc37b446484 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.518543 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T20:53:28Z', 'updated_at': '2021-11-18T20:53:38Z', 'revision_number': 2, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'gw_port_host': None, '_interfaces': [{'id': '257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5', 'name': '', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'mac_address': 'fa:16:3e:30:d0:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:38Z', 'updated_at': '2021-11-18T20:53:41Z', 'revision_number': 4, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'subnets': [{'id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:41.544626 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02498c74-ac94-4c3b-be50-bbc37b446484 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.547800 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-095e9db4-d82f-4429-b693-a8d0308a7d47 None None] The sync data for ids ['0541b491-b4f8-4eab-bf1b-95c62f407121'] in dv-cinder-799871-8-iscsi is: [{'id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T20:53:28Z', 'updated_at': '2021-11-18T20:53:38Z', 'revision_number': 2, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'gw_port_host': None, '_interfaces': [{'id': '257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5', 'name': '', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'mac_address': 'fa:16:3e:30:d0:a0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:38Z', 'updated_at': '2021-11-18T20:53:41Z', 'revision_number': 4, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'subnets': [{'id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 20:53:41.578807 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-02498c74-ac94-4c3b-be50-bbc37b446484 None None] For port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,segment=NetworkSegment(ed073cc9-f366-47ea-8658-f504d36a9812),segment_id=ed073cc9-f366-47ea-8658-f504d36a9812)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 20:53:41.582607 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02498c74-ac94-4c3b-be50-bbc37b446484 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:41.633902 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02498c74-ac94-4c3b-be50-bbc37b446484 None None] Pushing event updated for resources: {'Port': ['ID=257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:41.906660 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59162) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:42.018342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa71f91a-44ec-4e1e-8528-28db3d7455c0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:42.019710 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-aa71f91a-44ec-4e1e-8528-28db3d7455c0 admin admin] 10.222.0.61 "GET /v2.0/networks/3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 HTTP/1.1" status: 200 len: 842 time: 0.1120970 Nov 18 20:53:42.029636 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Request body: {'subnet': {'gateway_ip': '172.27.3.1', 'cidr': '172.27.3.0/24', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'ip_version': 4, 'name': 'public-subnet', 'enable_dhcp': False}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:42.050216 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Made reservation on behalf of 2069cde52ea54eb0bcf29170115b508e for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 20:53:42.052495 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:42.399242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.objects.ports [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=102669) get_objects /opt/stack/neutron/neutron/objects/ports.py:462}} Nov 18 20:53:42.399740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:42.455675 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3a94b01e-338e-4379-8e3f-ecc667769e62,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:42.464506 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:53:42.464858 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Network hostable DHCP agents. Network: 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 20:53:42.481921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 20:53:42.489665 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:53:42.494511 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:42.494814 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:42.501360 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a3732fd6-f324-4c43-9efe-57071210d52f None None] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:53:42.516979 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e999767f-6d53-43f2-8e87-f44cdf7fca11 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.4859107 Nov 18 20:53:42.643062 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a51af792-9ebc-4da4-a817-1dc308c891d4 None None] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:53:44.925691 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59170) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:45.055835 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-58756b6b-c88e-4c16-95d0-9392a234c99a admin admin] 10.222.0.61 "GET /v2.0/routers/0541b491-b4f8-4eab-bf1b-95c62f407121 HTTP/1.1" status: 200 len: 710 time: 0.1290452 Nov 18 20:53:45.143879 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-729b1467-e61f-4733-a70c-59ea50140ca1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:53:45.145182 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-729b1467-e61f-4733-a70c-59ea50140ca1 admin admin] 10.222.0.61 "GET /v2.0/networks/3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 HTTP/1.1" status: 200 len: 886 time: 0.0834372 Nov 18 20:53:45.155141 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:53:45.414018 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:45.655977 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:45.736048 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:45.842598 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Allocated IP 172.27.3.216 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/f7b1833f-5359-4c9c-a743-d44d643cf350) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 20:53:45.940967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:45.973824 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:46.015828 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 20:53:46.018645 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:53:46.022057 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 20:53:46.027198 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Pushing event updated for resources: {'Port': ['ID=f7b1833f-5359-4c9c-a743-d44d643cf350,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:46.350212 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:46.547858 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1025421', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1011836', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-27469'] for router, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:46.551437 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1025434', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1025507', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1011781'] for router, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:46.669956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Router 0541b491-b4f8-4eab-bf1b-95c62f407121 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 20:53:46.775217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 20:53:46.779597 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:46.780838 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f6d779df-5c28-4346-b080-1387fe218b78 admin admin] 10.222.0.61 "PUT /v2.0/routers/0541b491-b4f8-4eab-bf1b-95c62f407121 HTTP/1.1" status: 200 len: 890 time: 1.6288433 Nov 18 20:53:47.987124 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:53:48.037128 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:48.037496 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:48.568909 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Sync routers for ids ['0541b491-b4f8-4eab-bf1b-95c62f407121'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 20:53:48.580565 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Routers {'0541b491-b4f8-4eab-bf1b-95c62f407121'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 20:53:48.581229 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T20:53:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['0541b491-b4f8-4eab-bf1b-95c62f407121'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:48.788224 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Set router 0541b491-b4f8-4eab-bf1b-95c62f407121 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 20:53:49.272724 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.216'}], 'enable_snat': True}, 'gw_port_id': 'f7b1833f-5359-4c9c-a743-d44d643cf350', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T20:53:28Z', 'updated_at': '2021-11-18T20:53:46Z', 'revision_number': 4, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'gw_port': {'id': 'f7b1833f-5359-4c9c-a743-d44d643cf350', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:25:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:45Z', 'updated_at': '2021-11-18T20:53:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5', 'name': '', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'mac_address': 'fa:16:3e:30:d0:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:38Z', 'updated_at': '2021-11-18T20:53:41Z', 'revision_number': 5, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'subnets': [{'id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:49.325838 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Checking router: 0541b491-b4f8-4eab-bf1b-95c62f407121 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 20:53:49.326202 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Updating router 0541b491-b4f8-4eab-bf1b-95c62f407121 port f7b1833f-5359-4c9c-a743-d44d643cf350 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 20:53:49.336857 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59182) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:53:49.377110 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:49.454016 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-212820b5-b0df-4b15-96aa-3a19b83b59ed admin admin] 10.222.0.61 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 411 time: 0.1159551 Nov 18 20:53:49.716563 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:49.722534 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:49.777766 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076ee1af-1c5a-4b40-af7f-ed4bbba45bc5 None None] Pushing event updated for resources: {'Port': ['ID=f7b1833f-5359-4c9c-a743-d44d643cf350,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:49.781854 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Attempting to bind port f7b1833f-5359-4c9c-a743-d44d643cf350 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 20:53:49.782230 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Attempting to bind port f7b1833f-5359-4c9c-a743-d44d643cf350 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 20:53:49.782595 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Attempting to bind port f7b1833f-5359-4c9c-a743-d44d643cf350 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 20:53:49.787643 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 20, 53, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 20:53:49.788057 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:53:49.788457 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:49.789331 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 20:53:49.789807 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Bound port: f7b1833f-5359-4c9c-a743-d44d643cf350, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 20:53:49.790204 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:49.844373 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] For port f7b1833f-5359-4c9c-a743-d44d643cf350, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 20:53:49.847303 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] For port f7b1833f-5359-4c9c-a743-d44d643cf350, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=f7b1833f-5359-4c9c-a743-d44d643cf350,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 20:53:49.852980 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:49.912517 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-076ee1af-1c5a-4b40-af7f-ed4bbba45bc5 None None] Pushing event updated for resources: {'Port': ['ID=f7b1833f-5359-4c9c-a743-d44d643cf350,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:49.916669 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Routers {'0541b491-b4f8-4eab-bf1b-95c62f407121'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 20:53:49.917059 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T20:53:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['0541b491-b4f8-4eab-bf1b-95c62f407121'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:50.028842 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] Set router 0541b491-b4f8-4eab-bf1b-95c62f407121 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 20:53:50.247067 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.216'}], 'enable_snat': True}, 'gw_port_id': 'f7b1833f-5359-4c9c-a743-d44d643cf350', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T20:53:28Z', 'updated_at': '2021-11-18T20:53:46Z', 'revision_number': 4, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'gw_port': {'id': 'f7b1833f-5359-4c9c-a743-d44d643cf350', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:25:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:45Z', 'updated_at': '2021-11-18T20:53:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5', 'name': '', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'mac_address': 'fa:16:3e:30:d0:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:38Z', 'updated_at': '2021-11-18T20:53:41Z', 'revision_number': 5, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'subnets': [{'id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 20:53:50.274280 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fa8e2244-c8fa-41ba-93b8-74ba26085987 None None] The sync data for ids ['0541b491-b4f8-4eab-bf1b-95c62f407121'] in dv-cinder-799871-8-iscsi is: [{'id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'name': 'router1', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.216'}], 'enable_snat': True}, 'gw_port_id': 'f7b1833f-5359-4c9c-a743-d44d643cf350', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T20:53:28Z', 'updated_at': '2021-11-18T20:53:46Z', 'revision_number': 4, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'gw_port': {'id': 'f7b1833f-5359-4c9c-a743-d44d643cf350', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:b9:25:76', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.216', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:45Z', 'updated_at': '2021-11-18T20:53:49Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5', 'name': '', 'network_id': 'c9bb1884-bd7e-489c-b6ac-0e5095cbd555', 'tenant_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'mac_address': 'fa:16:3e:30:d0:a0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '0541b491-b4f8-4eab-bf1b-95c62f407121', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T20:53:38Z', 'updated_at': '2021-11-18T20:53:41Z', 'revision_number': 5, 'project_id': 'fa9679221f8241b2bbfa57a841d6f0db', 'subnets': [{'id': '1de83f46-0770-463e-8125-f93dabbe17b0', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': '7eb001ce-ab3b-4b22-9942-8b3c2fc3c398'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 20:53:52.012969 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device f7b1833f-5359-4c9c-a743-d44d643cf350 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:53:52.064984 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port f7b1833f-5359-4c9c-a743-d44d643cf350 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:52.065455 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:52.191730 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:52.214822 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port f7b1833f-5359-4c9c-a743-d44d643cf350, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=f7b1833f-5359-4c9c-a743-d44d643cf350,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 20:53:52.221350 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:53:52.270965 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=f7b1833f-5359-4c9c-a743-d44d643cf350,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:53:54.022387 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device f7b1833f-5359-4c9c-a743-d44d643cf350 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:53:54.077037 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port f7b1833f-5359-4c9c-a743-d44d643cf350 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:53:54.077037 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:02.151903 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d1edf2f4-aadd-4353-aa40-3dd94244b322 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:04.596372 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9e13a351-04d5-4e5c-a67b-a2bebb8e5972 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:04.759210 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:54:05.934830 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:07.384328 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:08.218949 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:32.157766 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cb6fefb5-a7e9-40fa-8aea-07a8ef97fc87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:34.592086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f1e39e1b-09e1-485a-948b-decd01f997ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:35.932683 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:37.382120 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:38.225204 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:54:41.758203 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:55:02.158262 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-49696bbe-1986-4918-ab16-31c342aac976 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:04.595102 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7ed84ba6-f331-40c5-8b34-8370c31a8400 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:05.933419 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:07.384806 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:08.221912 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:09.453767 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59666) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:09.515370 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.pecan_wsgi.hooks.translation [None req-54eef7ec-c7af-4a14-bb74-cf86fc9d18fc admin admin] GET failed (client error): The resource could not be found. Nov 18 20:55:09.516672 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-54eef7ec-c7af-4a14-bb74-cf86fc9d18fc admin admin] 10.222.0.61 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0616806 Nov 18 20:55:09.675825 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-386e7120-af31-4cf8-b741-1d794808b3b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:09.677197 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-386e7120-af31-4cf8-b741-1d794808b3b8 admin admin] 10.222.0.61 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1559525 Nov 18 20:55:11.979901 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59676) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:12.071219 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-36418841-3350-4ada-80d0-cce113be4af2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:12.072569 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-36418841-3350-4ada-80d0-cce113be4af2 admin admin] 10.222.0.61 "GET /v2.0/subnets/1de83f46-0770-463e-8125-f93dabbe17b0 HTTP/1.1" status: 200 len: 849 time: 0.0917125 Nov 18 20:55:12.082434 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:55:12.166677 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Publish callbacks [] for subnet, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:12.304388 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8748165435082'] for subnet, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:12.332849 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:12.333760 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:12.335376 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] 10.222.0.61 "PUT /v2.0/subnets/1de83f46-0770-463e-8125-f93dabbe17b0 HTTP/1.1" status: 200 len: 868 time: 0.2565265 Nov 18 20:55:12.337701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6a3109f-9c83-488c-a490-040fe5d096ff None None] Network c9bb1884-bd7e-489c-b6ac-0e5095cbd555 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:55:12.358073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Pushing event updated for resources: {'Subnet': ['ID=1de83f46-0770-463e-8125-f93dabbe17b0,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:55:12.365745 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.366100 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.366444 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.366783 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.367187 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.367442 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.367781 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.368156 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.368497 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.368826 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.369153 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.369480 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-8d11dc8a-9662-4daa-985f-c647d2fd043b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:55:12.708335 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-8f9d51a3-204a-44b3-94f7-7a292fd2e260 None None] Provisioning complete for port c67d8d04-d530-4192-85bc-dee249725c44 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:55:12.709161 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f9d51a3-204a-44b3-94f7-7a292fd2e260 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:12.795658 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-8f9d51a3-204a-44b3-94f7-7a292fd2e260 None None] Provisioning complete for port 257ac6c0-6c0d-4b2a-a4e3-c3250f10cae5 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:55:12.795917 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f9d51a3-204a-44b3-94f7-7a292fd2e260 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:14.679181 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59684) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:14.890139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b15c086f-711e-4c98-b967-912f56c75ffe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:14.890517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b15c086f-711e-4c98-b967-912f56c75ffe admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:14.892042 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b15c086f-711e-4c98-b967-912f56c75ffe admin admin] 10.222.0.61 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2118754 Nov 18 20:55:17.203707 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59692) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:17.331094 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b57e2a17-64a4-4fd6-aa01-fedff6b78939 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:17.331843 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b57e2a17-64a4-4fd6-aa01-fedff6b78939 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:17.333358 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b57e2a17-64a4-4fd6-aa01-fedff6b78939 admin admin] 10.222.0.61 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.1286788 Nov 18 20:55:18.757010 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:55:19.657632 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59700) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:19.783595 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06855966-be35-473c-b387-b8535b582d58 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:19.784994 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-06855966-be35-473c-b387-b8535b582d58 admin admin] 10.222.0.61 "GET /v2.0/networks/3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 HTTP/1.1" status: 200 len: 886 time: 0.1264179 Nov 18 20:55:22.134949 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59708) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:22.265748 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cdeac5c9-d46e-4a66-924b-b9f37ad39417 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:22.267109 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cdeac5c9-d46e-4a66-924b-b9f37ad39417 admin admin] 10.222.0.61 "GET /v2.0/networks/c9bb1884-bd7e-489c-b6ac-0e5095cbd555 HTTP/1.1" status: 200 len: 869 time: 0.1312041 Nov 18 20:55:24.578664 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59716) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:24.813030 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.policy [None req-0b36ccef-5b31-4a22-859b-c86028050487 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=102670) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 18 20:55:24.861658 dv-cinder-799871-8-iscsi neutron-server[102670]: WARNING oslo_policy.policy [None req-0b36ccef-5b31-4a22-859b-c86028050487 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:55:24.862041 dv-cinder-799871-8-iscsi neutron-server[102670]: WARNING oslo_policy.policy [None req-0b36ccef-5b31-4a22-859b-c86028050487 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 18 20:55:24.871142 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b36ccef-5b31-4a22-859b-c86028050487 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:24.871599 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0b36ccef-5b31-4a22-859b-c86028050487 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:24.873527 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0b36ccef-5b31-4a22-859b-c86028050487 admin admin] 10.222.0.61 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.2939210 Nov 18 20:55:27.172309 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59728) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:27.392877 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2afd3554-ce3c-4dc4-8caa-7026c99849f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:27.393242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2afd3554-ce3c-4dc4-8caa-7026c99849f0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:27.394772 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-2afd3554-ce3c-4dc4-8caa-7026c99849f0 admin admin] 10.222.0.61 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.2215185 Nov 18 20:55:29.691046 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59736) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:29.785044 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-80e4e53a-9dc9-4c4f-ae37-fe5264abd58d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:29.786388 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-80e4e53a-9dc9-4c4f-ae37-fe5264abd58d admin admin] 10.222.0.61 "GET /v2.0/subnets/1de83f46-0770-463e-8125-f93dabbe17b0 HTTP/1.1" status: 200 len: 868 time: 0.0943904 Nov 18 20:55:32.090025 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59744) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:32.160364 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7071028a-75d8-4bfc-8006-3f25d8aac53a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:32.209405 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06cd3453-3177-4dac-9b44-40a03eae0a7f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:32.210755 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-06cd3453-3177-4dac-9b44-40a03eae0a7f admin admin] 10.222.0.61 "GET /v2.0/subnets/3a94b01e-338e-4379-8e3f-ecc667769e62 HTTP/1.1" status: 200 len: 816 time: 0.1198649 Nov 18 20:55:34.598636 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-665521fd-ae7d-4f28-a35b-3ded9c81c589 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:35.937576 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:37.386762 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:38.216924 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:55:55.755465 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:55:56.733052 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59798) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:56.779748 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [None req-3220371f-dcae-4b6c-9ce7-27db5f5a0c8b admin admin] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 20:55:56.780768 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-3220371f-dcae-4b6c-9ce7-27db5f5a0c8b admin admin] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0467968 Nov 18 20:55:59.168701 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59806) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:55:59.244578 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.pecan_wsgi.hooks.translation [None req-13e39834-00b6-43fa-9e60-2d9605fbb320 admin admin] GET failed (client error): The resource could not be found. Nov 18 20:55:59.245873 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-13e39834-00b6-43fa-9e60-2d9605fbb320 admin admin] 10.222.0.61 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0762491 Nov 18 20:55:59.407398 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-06981d73-1d91-4b53-b7fd-667c6a020993 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:55:59.409169 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-06981d73-1d91-4b53-b7fd-667c6a020993 admin admin] 10.222.0.61 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1588128 Nov 18 20:56:01.753386 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59814) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:56:01.800408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Request body: {'network': {'shared': True, 'name': 'shared', 'admin_state_up': True}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:56:01.802191 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.quota [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Loaded quota_driver: . Nov 18 20:56:01.845020 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Made reservation on behalf of 2069cde52ea54eb0bcf29170115b508e for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 20:56:01.847740 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:01.889903 dv-cinder-799871-8-iscsi neutron-server[102670]: WARNING neutron.services.revisions.revision_plugin [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Could not find related network for resource to bump revision. Nov 18 20:56:01.910906 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 648} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 20:56:01.922899 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8748165505383', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:01.923463 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Unsubscribe: segment precommit_create {{(pid=102670) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 18 20:56:01.923947 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Added segment 82745c4d-5ef9-430f-8b50-cf3a463c6b2c of type vlan for network 386cda10-1308-4cee-8772-8fb3decbfacb Nov 18 20:56:01.986000 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:02.021313 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:02.022516 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:56:02.023119 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:02.049022 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.2945571 Nov 18 20:56:02.137883 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Pushing event updated for resources: {'Network': ['ID=386cda10-1308-4cee-8772-8fb3decbfacb,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:56:02.149437 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.149827 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.150125 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.150457 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.150784 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.151112 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.151436 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.151770 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.152133 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.152464 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.153205 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.153205 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa971620-f819-4e9a-bcfe-2809193e46b8 admin admin] Tracked resource versions report: Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: pushed versions: Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: { 'AddressGroup': {'1.2'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'ConntrackHelper': {'1.0'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Log': {'1.0'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Network': {'1.1'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Port': {'1.7'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'PortForwarding': {'1.2'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'QosPolicy': {'1.10'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroup': {'1.5'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroupRule': {'1.2'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SubPort': {'1.0'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Subnet': {'1.1'}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Trunk': {'1.1'}} Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: consumer versions: Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'ConntrackHelper': '1.0', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Log': '1.0', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Network': '1.1', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Port': '1.7', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'PortForwarding': '1.2', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'QosPolicy': '1.10', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroup': '1.5', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroupRule': '1.2', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SubPort': '1.0', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Subnet': '1.1', Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Trunk': '1.1'}} Nov 18 20:56:02.154134 dv-cinder-799871-8-iscsi neutron-server[102670]: {{(pid=102670) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 20:56:02.166604 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-87e0e7d9-d065-4997-8c90-0319942c0ce4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:02.200370 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 386cda10-1308-4cee-8772-8fb3decbfacb details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 20:56:04.392241 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59826) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:56:04.452547 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.pecan_wsgi.hooks.translation [None req-062d76ec-37fa-4d15-9d6a-3562785cb5db admin admin] GET failed (client error): The resource could not be found. Nov 18 20:56:04.453802 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-062d76ec-37fa-4d15-9d6a-3562785cb5db admin admin] 10.222.0.61 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0605936 Nov 18 20:56:04.543764 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01710bae-9bbb-4936-890a-01dc868593af admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:56:04.545130 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-01710bae-9bbb-4936-890a-01dc868593af admin admin] 10.222.0.61 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.0863543 Nov 18 20:56:04.555273 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Request body: {'subnet': {'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb', 'name': 'shared-subnet', 'cidr': '192.168.233.0/24', 'ip_version': 4, 'description': 'shared-subnet'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 20:56:04.577062 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Made reservation on behalf of 2069cde52ea54eb0bcf29170115b508e for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 20:56:04.579200 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Publish callbacks [] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:04.601303 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e34b2b97-f0af-4ef9-8186-ee3d3bf80866 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:04.810686 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:04.871049 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Pushing event updated for resources: {'Subnet': ['ID=1928d678-7ced-4a10-b464-3501d4344ed0,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:56:04.879399 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Checking segment: {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:56:04.880860 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Network hostable DHCP agents. Network: 386cda10-1308-4cee-8772-8fb3decbfacb, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 20:56:04.901323 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Network 386cda10-1308-4cee-8772-8fb3decbfacb is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 20:56:04.912312 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 386cda10-1308-4cee-8772-8fb3decbfacb) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:56:04.917136 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 20:56:04.917817 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:04.922692 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a284c202-37ad-4604-8d7d-7dab7581b3ee None None] Network 386cda10-1308-4cee-8772-8fb3decbfacb requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:56:04.933495 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-3a6b1801-fe75-4245-82ce-eca0c37cb54a admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.3814766 Nov 18 20:56:05.172683 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-386cda10-1308-4cee-8772-8fb3decbfacb', 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb', 'tenant_id': '2069cde52ea54eb0bcf29170115b508e', 'fixed_ips': [{'subnet_id': '1928d678-7ced-4a10-b464-3501d4344ed0'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 20:56:05.173570 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:05.321793 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Allocated IP 192.168.233.2 (386cda10-1308-4cee-8772-8fb3decbfacb/1928d678-7ced-4a10-b464-3501d4344ed0/9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 20:56:05.475701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:05.481997 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:05.524940 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Pushing event updated for resources: {'Port': ['ID=9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:56:05.531431 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Network 386cda10-1308-4cee-8772-8fb3decbfacb is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 20:56:05.536455 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 20:56:05.539285 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.539655 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.540001 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.540354 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.540690 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.541024 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.541347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.541668 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.542013 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.542336 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.542654 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.542970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:56:05.556727 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 20:56:05.618354 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Attempting to bind port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 20:56:05.619003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Attempting to bind port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 20:56:05.619194 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Attempting to bind port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 on network 386cda10-1308-4cee-8772-8fb3decbfacb {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 20:56:05.624832 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 20, 55, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 20:56:05.625208 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Checking segment: {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 20:56:05.625612 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:05.626008 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Bound using segment: {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 20:56:05.626479 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Bound port: 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 20:56:05.626876 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:05.693781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-02a26433-7de7-4105-9495-c21d678409ce None None] For port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 20:56:05.696886 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-02a26433-7de7-4105-9495-c21d678409ce None None] For port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 20:56:05.703098 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:05.763883 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02a26433-7de7-4105-9495-c21d678409ce None None] Pushing event updated for resources: {'Port': ['ID=9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:56:05.944505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:06.091843 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:56:06.142008 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:56:06.142300 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:06.226322 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:06.260711 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 20:56:06.264778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:06.312496 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:56:06.647346 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a7a3305-3856-4f67-8ece-e711b1e8fba4 None None] Network 386cda10-1308-4cee-8772-8fb3decbfacb requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 20:56:06.769505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-7dd95dcc-d091-4c92-8f94-f41b43c4bec7 None None] Provisioning complete for port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:56:06.769794 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7dd95dcc-d091-4c92-8f94-f41b43c4bec7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:07.113671 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-ddbe1274-e370-44be-9521-e914fee1b43d None None] Provisioning complete for port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:56:07.114714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ddbe1274-e370-44be-9521-e914fee1b43d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:07.402089 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:08.046621 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 20:56:08.095429 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 9e7c47b0-1b91-4ca6-ad05-ead92ecc21e2 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 20:56:08.095789 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:08.218541 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:32.169027 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-53c150ac-7e97-47a0-a73f-cb03cb958db8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:32.753690 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:56:34.603402 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6b535f0d-ee70-492e-bcf3-30f01e1adf3f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:35.946090 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:37.393439 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:56:38.222691 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:02.170337 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dbe9d18d-b5b9-4f49-8908-1d5f4f66a529 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:04.606858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fd86409e-b4ed-4626-a3c6-4a88ffeea8da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:05.949072 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:07.396906 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:08.218285 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:09.752142 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:57:18.046853 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59872) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:57:18.052748 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [None req-29a58c1b-c21d-46e4-9420-930c6d86bad6 tempest-verify_tempest_config-920318136 tempest-verify_tempest_config-920318136-project] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 20:57:18.053714 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-29a58c1b-c21d-46e4-9420-930c6d86bad6 tempest-verify_tempest_config-920318136 tempest-verify_tempest_config-920318136-project] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14077 time: 0.0058804 Nov 18 20:57:18.339478 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 59890) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:57:18.446125 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.550314 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.554318 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.597698 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=430d8d012e93404992ae75729e45e4c9&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2572081 Nov 18 20:57:18.599962 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4d93329-6505-4579-bf87-5546119c1a2a,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:57:18.601085 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59894) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:57:18.606955 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.607333 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.607677 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.608013 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.608371 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.608709 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.609034 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.609363 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.609684 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.610009 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.610329 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.610648 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e970641a-80dc-40c2-bb84-1c4df3c47401 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.656673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.678135 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.768480 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.771279 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:18.772489 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f4d93329-6505-4579-bf87-5546119c1a2a HTTP/1.1" status: 204 len: 168 time: 0.1701365 Nov 18 20:57:18.780560 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4d93329-6505-4579-bf87-5546119c1a2a,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 20:57:18.787579 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.787953 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.788334 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.788668 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.788999 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.789342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.789672 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.790009 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.790351 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.790674 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.790993 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:18.791333 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5c993ffc-ebde-4aab-8bf1-75d4536a1b54 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 20:57:32.172675 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-38fe0e1c-8c2c-4c89-a3bb-5bef9bb3d9b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:34.609011 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5ba03ab3-6e14-430d-b0dc-43b38788093a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:35.953606 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:37.400577 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:38.220891 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:57:46.749919 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:58:02.179536 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6a3f1843-da3a-476d-9061-34c0271469a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:04.610682 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7d7d6bac-23cc-4747-b366-cd478a907da7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:05.952951 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:07.403502 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:08.222330 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:23.747710 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 5 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:58:32.171944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-803385e4-df4d-49fe-b560-2df87a97699f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:34.621944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0a54700a-8e8b-47eb-bb53-110a664420b2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:35.971170 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:37.417992 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:38.227662 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:58:49.283506 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1015779'] for agent, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:00.750342 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:59:02.175166 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6797f82e-fea0-43bc-9a06-77709b8c7d53 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:04.208151 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59968) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:59:04.313835 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-701e8796-1f4f-4769-a42b-c164264d4623 admin admin] 10.222.0.61 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1045136 Nov 18 20:59:04.615155 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b980e255-78b8-46ab-a66d-ffd1aa94da7f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:05.962233 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:06.644490 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 59978) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 20:59:06.698489 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-6ea821c2-94cc-4414-960e-27bfe83ddc3e admin admin] 10.222.0.61 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0523133 Nov 18 20:59:07.410462 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:08.232158 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:19.233034 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:32.177084 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-92721a69-a9e4-4480-9872-387aa8cd8f08 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:34.618012 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6dca5eb1-d424-40c6-a6e4-ba4e5d8c2ac4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:35.964321 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:37.414553 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:37.748645 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 20:59:38.235304 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 20:59:49.240188 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:02.186672 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b02493ec-ba4e-454b-89c0-83bbd860c17c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:04.628311 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-415fbeeb-6fec-47fc-9bba-ca680db5638c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:05.966700 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:07.416083 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:08.237637 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:14.748080 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:00:19.249303 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:32.199526 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e8585608-a483-46f2-afe3-218af76bfe37 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:34.622354 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a13f245e-8f37-4f3d-928f-896c8c146916 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:35.740579 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60192) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:35.933910 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60212) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:35.972576 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:35.983735 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60216) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:36.099821 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-152130367-network', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:36.127516 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Made reservation on behalf of d6128eda2acb42f3b896c4d4a809ed0e for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:36.129986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.138890 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.152312 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60226) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:36.231892 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-83558646-network', 'tenant_id': 'd84c0234ebde42a9a24ece0729b10890'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:36.261569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.267080 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.276371 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-network', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:36.283266 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 614} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:00:36.294390 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.294646 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Added segment 92b0e715-6270-4ec3-92fa-a68032c1ba37 of type vlan for network c212623b-e2b5-4f51-9cd5-a24f8a69f653 Nov 18 21:00:36.297513 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Made reservation on behalf of d84c0234ebde42a9a24ece0729b10890 for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:36.299945 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.311614 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Made reservation on behalf of 5c11bd4ad5214d279c477c233d05b6d3 for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:36.316237 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.333740 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.361638 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.386509 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.390811 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.392001 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:36.392604 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.424915 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 0.6834414 Nov 18 21:00:36.425810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60238) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:36.434923 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Request body: {'subnet': {'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-subnet', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:36.439263 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.445702 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.470933 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 640} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:00:36.475294 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Made reservation on behalf of d6128eda2acb42f3b896c4d4a809ed0e for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:36.477889 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.488207 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.488579 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Added segment 346175a8-8f3b-4db0-acce-2b22e5308fa2 of type vlan for network 5973daa9-793c-40f5-972b-25507ee923a3 Nov 18 21:00:36.541455 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.601137 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=827e81d5-c5d1-4ee0-9f96-e195ef77902b,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:36.609656 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.610827 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:36.611505 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.625444 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.625865 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.626225 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.626849 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.627200 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.627817 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.628315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.628970 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.629393 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.629732 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.630111 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.630447 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Tracked resource versions report: Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: pushed versions: Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: { 'AddressGroup': {'1.2'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'ConntrackHelper': {'1.0'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Log': {'1.0'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Network': {'1.1'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Port': {'1.7'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'PortForwarding': {'1.2'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'QosPolicy': {'1.10'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroup': {'1.5'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroupRule': {'1.2'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SubPort': {'1.0'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Subnet': {'1.1'}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Trunk': {'1.1'}} Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: consumer versions: Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: HyperV agent@hv-cinder-79987: {}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'ConntrackHelper': '1.0', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Log': '1.0', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Network': '1.1', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Port': '1.7', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'PortForwarding': '1.2', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'QosPolicy': '1.10', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroup': '1.5', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SecurityGroupRule': '1.2', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'SubPort': '1.0', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Subnet': '1.1', Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: 'Trunk': '1.1'}} Nov 18 21:00:36.631604 dv-cinder-799871-8-iscsi neutron-server[102670]: {{(pid=102670) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 21:00:36.712555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-387723880-network', 'tenant_id': '05431e285025437d8783475290b4e4fc'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:36.716871 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] Pushing event updated for resources: {'Network': ['ID=5973daa9-793c-40f5-972b-25507ee923a3,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:36.729921 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 5973daa9-793c-40f5-972b-25507ee923a3 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:00:36.731770 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.733989 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6c562da9-f792-4341-9325-18e7b61e87bf admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 0.7489576 Nov 18 21:00:36.737511 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60244) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:36.752291 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Request body: {'subnet': {'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-subnet', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:36.834560 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Made reservation on behalf of 5c11bd4ad5214d279c477c233d05b6d3 for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:36.839222 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Publish callbacks [] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:36.850631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8b6f53da-46a6-498b-85f0-a7f58334c536,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:36.891715 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.892066 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.892420 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.892751 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.893272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.893766 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.894257 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.894751 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.895248 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.895963 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.896320 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.896657 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Tracked resource versions report: Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: pushed versions: Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: { 'AddressGroup': {'1.2'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'ConntrackHelper': {'1.0'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Log': {'1.0'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Network': {'1.1'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Port': {'1.7'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'PortForwarding': {'1.2'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'QosPolicy': {'1.10'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroup': {'1.5'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroupRule': {'1.2'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SubPort': {'1.0'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Subnet': {'1.1'}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Trunk': {'1.1'}} Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: consumer versions: Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: HyperV agent@hv-cinder-79987: {}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'ConntrackHelper': '1.0', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Log': '1.0', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Network': '1.1', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Port': '1.7', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'PortForwarding': '1.2', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'QosPolicy': '1.10', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroup': '1.5', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SecurityGroupRule': '1.2', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'SubPort': '1.0', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Subnet': '1.1', Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: 'Trunk': '1.1'}} Nov 18 21:00:36.897610 dv-cinder-799871-8-iscsi neutron-server[102669]: {{(pid=102669) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 21:00:37.038339 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Checking segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:37.039016 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Network hostable DHCP agents. Network: c212623b-e2b5-4f51-9cd5-a24f8a69f653, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:00:37.052825 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Made reservation on behalf of 05431e285025437d8783475290b4e4fc for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:37.055376 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.070301 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.103840 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ebf82b44-6c1a-4529-83a5-eeabe0b72d92 admin admin] Pushing event updated for resources: {'Network': ['ID=c212623b-e2b5-4f51-9cd5-a24f8a69f653,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:37.110250 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=bc253697-be56-4044-aeb5-455225f5b7ab,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:37.117912 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:00:37.187577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:00:37.199806 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.247196 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, c212623b-e2b5-4f51-9cd5-a24f8a69f653) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:37.273315 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:37.273909 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.284944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d66b636f-6f95-453d-ba17-e87020e2d601 None None] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:37.302155 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.323063 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.365177 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Pushing event updated for resources: {'Subnet': ['ID=ecbb94e2-6852-471b-9339-07ed4834cbe7,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:37.377873 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Checking segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:37.383054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5cfca977-5b49-4862-a9f2-ffb9073db5a4 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.9523284 Nov 18 21:00:37.383872 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Network hostable DHCP agents. Network: 5973daa9-793c-40f5-972b-25507ee923a3, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:00:37.386375 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60284) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:37.398110 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 622} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:00:37.401783 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:37.414088 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.414666 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Added segment 1822c8a3-e235-4644-8a58-074d8932baed of type vlan for network f1ea2660-7fe2-437d-9b30-7d386db79f6c Nov 18 21:00:37.459408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.479464 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.481097 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.497943 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.499589 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:37.500422 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.505806 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Network 5973daa9-793c-40f5-972b-25507ee923a3 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:00:37.543551 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 5973daa9-793c-40f5-972b-25507ee923a3) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:37.579663 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e5d77c7d-5830-4063-8b24-6fe5abb291fa None None] Network 5973daa9-793c-40f5-972b-25507ee923a3 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:37.601268 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:37.601268 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.657199 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Pushing event updated for resources: {'Network': ['ID=f1ea2660-7fe2-437d-9b30-7d386db79f6c,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:37.659138 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c187060e-d2ce-4a0f-a084-e32892be1597,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:37.678906 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.692596 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.698193 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-84402a01-6495-4015-9903-722c4b631ade admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 0.9578629 Nov 18 21:00:37.709165 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f94a09de-0ebd-4a4f-936a-f2b8fa25237e admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 1.7701654 Nov 18 21:00:37.712895 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:00:37.714300 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.716610 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network f1ea2660-7fe2-437d-9b30-7d386db79f6c details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:00:37.718522 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60302) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:37.718870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60304) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:37.750855 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:37.762371 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Request body: {'subnet': {'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-83558646-subnet', 'tenant_id': 'd84c0234ebde42a9a24ece0729b10890', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:37.825925 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Made reservation on behalf of d84c0234ebde42a9a24ece0729b10890 for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:37.840375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.928960 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:37.967575 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ce6e853-98ac-45b9-bcc1-a8d86c7b9fa2 None None] Network 5973daa9-793c-40f5-972b-25507ee923a3 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:38.031106 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.068579 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.081948 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.086515 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.218526 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 604} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:00:38.234317 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.235006 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Added segment 26679146-5e5a-421c-8b63-f1f783adcc41 of type vlan for network 2d6a6844-15e6-4a14-9103-24e890fa190f Nov 18 21:00:38.247431 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Allocated IP 172.20.0.2 (c212623b-e2b5-4f51-9cd5-a24f8a69f653/bc253697-be56-4044-aeb5-455225f5b7ab/80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:38.300100 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.360789 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.362003 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:38.363854 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.386282 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.458500 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Pushing event updated for resources: {'Network': ['ID=2d6a6844-15e6-4a14-9103-24e890fa190f,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:38.474639 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d662157f-d131-4a4f-9901-a31465806480,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:38.500290 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 2d6a6844-15e6-4a14-9103-24e890fa190f details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:00:38.538178 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e5596248-a7a0-4822-8e67-cb08a5f92156 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 2.3815675 Nov 18 21:00:38.539007 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60328) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:38.569271 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Request body: {'subnet': {'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-387723880-subnet', 'tenant_id': '05431e285025437d8783475290b4e4fc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:38.579147 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.635798 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.658812 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.673455 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60332) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:38.791892 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Made reservation on behalf of 05431e285025437d8783475290b4e4fc for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:38.799885 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.801709 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.814083 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:38.924807 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:38.937239 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:38.949816 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:38.959852 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Pushing event updated for resources: {'Port': ['ID=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:38.999789 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.005485 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.005485 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.005888 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.006471 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.006684 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.006886 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.007587 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.008711 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.009223 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.015236 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.015569 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.015995 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.016654 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Tracked resource versions report: Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: pushed versions: Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: { 'AddressGroup': {'1.2'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'ConntrackHelper': {'1.0'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Log': {'1.0'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Network': {'1.1'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Port': {'1.7'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'PortForwarding': {'1.2'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'QosPolicy': {'1.10'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroup': {'1.5'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroupRule': {'1.2'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SubPort': {'1.0'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Subnet': {'1.1'}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Trunk': {'1.1'}} Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: consumer versions: Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: HyperV agent@hv-cinder-79987: {}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'ConntrackHelper': '1.0', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Log': '1.0', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Network': '1.1', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Port': '1.7', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'PortForwarding': '1.2', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'QosPolicy': '1.10', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroup': '1.5', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SecurityGroupRule': '1.2', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'SubPort': '1.0', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Subnet': '1.1', Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: 'Trunk': '1.1'}} Nov 18 21:00:39.019894 dv-cinder-799871-8-iscsi neutron-server[102671]: {{(pid=102671) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 21:00:39.090090 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Attempting to bind port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:00:39.092179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Attempting to bind port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:00:39.092801 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Attempting to bind port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:39.106717 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-30df3df3-03b3-40d3-930c-5f83be866741 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.116821 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:00:39.117365 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Checking segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:39.117776 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.118171 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Bound using segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:00:39.118655 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Bound port: 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:00:39.119784 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.146028 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Pushing event updated for resources: {'Subnet': ['ID=39256260-0b56-47a0-a1ad-a05a1ac59638,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:39.198761 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Allocated IP 172.27.3.213 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/3b9f5963-1c82-4a66-878b-8061c8718e60) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:39.272992 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] For port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:00:39.278026 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] For port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:00:39.290452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.356453 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Checking segment: {'id': '1822c8a3-e235-4644-8a58-074d8932baed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:39.356999 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Network hostable DHCP agents. Network: f1ea2660-7fe2-437d-9b30-7d386db79f6c, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:00:39.415111 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Network f1ea2660-7fe2-437d-9b30-7d386db79f6c is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:00:39.438268 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, f1ea2660-7fe2-437d-9b30-7d386db79f6c) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:39.454764 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0ce83a87-98f6-4478-b3e7-d22723c9884f None None] Network f1ea2660-7fe2-437d-9b30-7d386db79f6c requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:39.458089 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:39.458921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.485858 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.535434 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9943bc2-5b63-446f-97b5-7281964b2475 None None] Pushing event updated for resources: {'Port': ['ID=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:39.575150 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-30df3df3-03b3-40d3-930c-5f83be866741 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.610492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60372) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:39.633529 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-30df3df3-03b3-40d3-930c-5f83be866741 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.634058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.649856 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7470cfba-a95b-4aaa-8778-67994e560d75 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 1.9286342 Nov 18 21:00:39.722228 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.844881 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:39.937073 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-391d67c3-5ca4-4391-9ac3-1f424382c83e None None] Network f1ea2660-7fe2-437d-9b30-7d386db79f6c requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:39.937545 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:39.937545 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-30df3df3-03b3-40d3-930c-5f83be866741 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=b88f8c8799e64d6195f4b05f9be1f74c&name=default HTTP/1.1" status: 200 len: 2992 time: 1.2045572 Nov 18 21:00:39.937810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60384) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:39.937901 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30df3df3-03b3-40d3-930c-5f83be866741 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c830016c-144a-40fa-af1c-6a69df460e15,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:39.960262 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Checking segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:39.960262 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Network hostable DHCP agents. Network: 2d6a6844-15e6-4a14-9103-24e890fa190f, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:00:39.974597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-87485e1b-ad06-4511-bb1f-1b9f5760fcfd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.065506 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f698f7a-5fb2-4a7a-b03c-9c07c090ea84 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.069323 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Network 2d6a6844-15e6-4a14-9103-24e890fa190f is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:00:40.102701 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.163099 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f698f7a-5fb2-4a7a-b03c-9c07c090ea84 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.229985 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 2d6a6844-15e6-4a14-9103-24e890fa190f) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:40.243520 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c4a15dff-a44d-4e51-873a-f796048bb85c None None] Network 2d6a6844-15e6-4a14-9103-24e890fa190f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:40.271791 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Allocated IP 172.27.3.75 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/0ab796a4-5d10-4a4d-a1a8-8689972297d7) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:40.277457 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:40.278340 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.314930 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:40.341818 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:40.342581 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:40.347642 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:40.350348 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Pushing event updated for resources: {'Port': ['ID=3b9f5963-1c82-4a66-878b-8061c8718e60,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:40.440869 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6ae088d8-34a8-48e5-a097-a8067708e4e0 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 1.9006886 Nov 18 21:00:40.501869 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f698f7a-5fb2-4a7a-b03c-9c07c090ea84 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.507897 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f698f7a-5fb2-4a7a-b03c-9c07c090ea84 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.512623 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8f698f7a-5fb2-4a7a-b03c-9c07c090ea84 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/c830016c-144a-40fa-af1c-6a69df460e15 HTTP/1.1" status: 204 len: 168 time: 0.6029580 Nov 18 21:00:40.580438 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:40.585347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.592378 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f698f7a-5fb2-4a7a-b03c-9c07c090ea84 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c830016c-144a-40fa-af1c-6a69df460e15,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:40.673012 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-87485e1b-ad06-4511-bb1f-1b9f5760fcfd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.693761 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60422) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:40.701671 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-87485e1b-ad06-4511-bb1f-1b9f5760fcfd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.708004 dv-cinder-799871-8-iscsi neutron-server[102670]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 18 21:00:40.784596 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.894299 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:40.939961 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0507f924-9b21-4f98-8a90-5367aa193be2 None None] Network 2d6a6844-15e6-4a14-9103-24e890fa190f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:40.999155 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:41.013870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:41.017843 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:41.143098 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Pushing event updated for resources: {'Port': ['ID=0ab796a4-5d10-4a4d-a1a8-8689972297d7,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:41.160507 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.218414 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-87485e1b-ad06-4511-bb1f-1b9f5760fcfd admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=755fa2c5c3e04f1d9234ab5c1ff9264c&name=default HTTP/1.1" status: 200 len: 2992 time: 1.6018822 Nov 18 21:00:41.236540 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60436) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:41.237520 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87485e1b-ad06-4511-bb1f-1b9f5760fcfd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ef91f5f6-2438-4f1c-a1ee-901f46202eae,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:41.293356 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:00:41.310223 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.327994 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60438) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:41.357055 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cace5cb1-3fec-4410-915b-03da8d795145 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.393325 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5a9fe1a3-6c87-4955-8ad9-106d5d24f16b None None] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:00:41.458563 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60452) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:41.462484 dv-cinder-799871-8-iscsi neutron-server[102669]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 18 21:00:41.502132 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:41.568885 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.578307 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-03b9a0b0-ae1d-49e1-9088-0b00311ac256 None None] Provisioning complete for port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:41.578769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-03b9a0b0-ae1d-49e1-9088-0b00311ac256 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.676717 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-50dde002-45be-4972-8e18-766c87efd8be tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:41.678402 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-50dde002-45be-4972-8e18-766c87efd8be tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/networks?id=f1ea2660-7fe2-437d-9b30-7d386db79f6c HTTP/1.1" status: 200 len: 810 time: 0.9736328 Nov 18 21:00:41.724295 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-3c712b88-a2cb-4185-9f5b-981c84f3336f tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/quotas/d84c0234ebde42a9a24ece0729b10890 HTTP/1.1" status: 200 len: 375 time: 0.0304532 Nov 18 21:00:41.727026 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.773564 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9bca-6124-4319-9d0a-561ecd8f3356 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.802428 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cace5cb1-3fec-4410-915b-03da8d795145 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.816296 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cace5cb1-3fec-4410-915b-03da8d795145 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.843178 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-0facc8ed-f82f-4333-9d46-b5ee4e488421 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=d84c0234ebde42a9a24ece0729b10890&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1109447 Nov 18 21:00:41.859743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-fdd3c8e5-f7ac-48db-bff0-62fab2e5ee37 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:41.861160 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-fdd3c8e5-f7ac-48db-bff0-62fab2e5ee37 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.4015162 Nov 18 21:00:41.945608 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9bca-6124-4319-9d0a-561ecd8f3356 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:41.959499 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cace5cb1-3fec-4410-915b-03da8d795145 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=63c40cb7e62b4b27977c0ddcc6d9b34f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6303742 Nov 18 21:00:41.967412 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60476) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:41.968376 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cace5cb1-3fec-4410-915b-03da8d795145 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c888ff3a-3024-4061-acb7-000f8c3ef301,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:41.973385 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-48a84c83-0e1f-48a9-9588-4e9b3d69dfc3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/quotas/05431e285025437d8783475290b4e4fc HTTP/1.1" status: 200 len: 375 time: 0.0554013 Nov 18 21:00:42.111226 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-10468ea0-cfaa-4481-ad54-9e667a5b291e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1278644 Nov 18 21:00:42.158792 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.227704 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c74d17fb-56d1-4d57-ad99-de3d736dff4c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.246855 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-e8b676e8-61d7-4e2d-a6f4-c2a50e9e8b7c None None] Provisioning complete for port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:42.247371 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e8b676e8-61d7-4e2d-a6f4-c2a50e9e8b7c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.283688 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.285321 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:42.299202 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c74d17fb-56d1-4d57-ad99-de3d736dff4c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.312476 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-81bad998-fdf3-4a2d-ad14-fbd08044b636 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:00:42.316686 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-81bad998-fdf3-4a2d-ad14-fbd08044b636 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.2118905 Nov 18 21:00:42.329513 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9bca-6124-4319-9d0a-561ecd8f3356 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.335755 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9b1c9bca-6124-4319-9d0a-561ecd8f3356 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.338919 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-9b1c9bca-6124-4319-9d0a-561ecd8f3356 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/ef91f5f6-2438-4f1c-a1ee-901f46202eae HTTP/1.1" status: 204 len: 168 time: 1.0868709 Nov 18 21:00:42.429352 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-7475c614-b059-4fdd-bdb4-9053d5f651b1 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:00:42.431914 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-7475c614-b059-4fdd-bdb4-9053d5f651b1 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1094108 Nov 18 21:00:42.465140 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9b1c9bca-6124-4319-9d0a-561ecd8f3356 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ef91f5f6-2438-4f1c-a1ee-901f46202eae,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:42.544883 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:42.545458 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.606150 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Router 141c8833-0a33-4ff3-bb35-3a9703fba940 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102669) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:00:42.617259 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-c1a9f259-50f8-4a60-8b67-98c264302ccf service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1724796 Nov 18 21:00:42.636447 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c74d17fb-56d1-4d57-ad99-de3d736dff4c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.639226 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c74d17fb-56d1-4d57-ad99-de3d736dff4c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:42.643262 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c74d17fb-56d1-4d57-ad99-de3d736dff4c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/c888ff3a-3024-4061-acb7-000f8c3ef301 HTTP/1.1" status: 204 len: 168 time: 0.6732421 Nov 18 21:00:42.664595 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b8d7d966-bc1b-49de-b477-485a68ca804e service neutron] 10.222.0.61 "GET /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3241611 Nov 18 21:00:42.776811 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-0823fca0-c4e5-4d0c-99d4-637f2a857486 service neutron] 10.222.0.61 "GET /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1111708 Nov 18 21:00:42.782793 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c74d17fb-56d1-4d57-ad99-de3d736dff4c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c888ff3a-3024-4061-acb7-000f8c3ef301,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:42.903313 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102670) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:00:43.013233 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-93205f2e-263b-47b0-b17c-11017f982517 service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3846376 Nov 18 21:00:43.014738 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:00:43.026026 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Sync routers for ids ['141c8833-0a33-4ff3-bb35-3a9703fba940'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:00:43.041355 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Routers {'141c8833-0a33-4ff3-bb35-3a9703fba940'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:43.042199 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['141c8833-0a33-4ff3-bb35-3a9703fba940'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:43.046642 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:43.051012 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-31fc4927-1d98-4502-849a-0f70bf2dd8d5 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 930 time: 5.3283339 Nov 18 21:00:43.051163 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60510) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:43.115481 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:00:43.130538 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:00:43.150933 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:43.151669 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:43.160815 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:43.165121 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60518) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:43.169468 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-d8d27545-f4bd-4afb-b293-22c660929b21 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 5.7744956 Nov 18 21:00:43.393068 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Set router 141c8833-0a33-4ff3-bb35-3a9703fba940 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:43.439775 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:43.604372 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fee224da-a2f3-4f5a-9567-0dd2511b4201 req-08b46493-4e1d-4717-b418-4a4254365fa5 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 210 time: 0.1199629 Nov 18 21:00:43.725599 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b8bef557-1d8e-4e00-90a2-1c700b441501 req-1cbe1858-1c9c-49a3-80db-6804b7ebd801 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.0539114 Nov 18 21:00:43.979110 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:40Z', 'revision_number': 3, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:44.054834 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:00:44.058427 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Updating router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 port 3b9f5963-1c82-4a66-878b-8061c8718e60 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:00:44.095187 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:41Z', 'revision_number': 3, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:40Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:44.130817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:44.187125 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Checking router: 141c8833-0a33-4ff3-bb35-3a9703fba940 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:00:44.189916 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Updating router 141c8833-0a33-4ff3-bb35-3a9703fba940 port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:00:44.265011 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:44.467147 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60612) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:44.706508 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:44.750537 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:44.800011 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ab02c800-4f2c-4e12-87f2-bdd87ea15d3a req-8def0fb5-6f89-4786-9252-ee0e2ae51efd tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 210 time: 0.0757985 Nov 18 21:00:44.966517 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f76cccf-b35d-45ad-8aaa-296dfa9e6374 req-deaef6ed-d519-47bb-ae39-506daaa501c4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.0728436 Nov 18 21:00:45.003149 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05650785-d578-4c86-ab52-656135d110fa admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.034354 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d4a711-fa37-4890-a4e4-e3d87cb0114d None None] Pushing event updated for resources: {'Port': ['ID=3b9f5963-1c82-4a66-878b-8061c8718e60,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:45.083804 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Attempting to bind port 3b9f5963-1c82-4a66-878b-8061c8718e60 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:00:45.084480 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Attempting to bind port 3b9f5963-1c82-4a66-878b-8061c8718e60 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:00:45.085052 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Attempting to bind port 3b9f5963-1c82-4a66-878b-8061c8718e60 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:45.109581 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:00:45.110310 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:45.112097 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.113179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:00:45.115009 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Bound port: 3b9f5963-1c82-4a66-878b-8061c8718e60, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:00:45.117180 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.148133 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.230452 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05650785-d578-4c86-ab52-656135d110fa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.236579 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05650785-d578-4c86-ab52-656135d110fa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.300372 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05650785-d578-4c86-ab52-656135d110fa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a892bc10-4c41-4ae1-a8a6-57faf68d4357,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:45.349973 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-05650785-d578-4c86-ab52-656135d110fa admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=ab12d87bd3844266909d55e90852002f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8807309 Nov 18 21:00:45.355024 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60656) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:45.460595 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.468685 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] For port 3b9f5963-1c82-4a66-878b-8061c8718e60, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:00:45.473545 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.482944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] For port 3b9f5963-1c82-4a66-878b-8061c8718e60, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=3b9f5963-1c82-4a66-878b-8061c8718e60,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:00:45.498163 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.529309 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Pushing event updated for resources: {'Port': ['ID=0ab796a4-5d10-4a4d-a1a8-8689972297d7,revision_number=2']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:45.541146 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.542081 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.543097 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.543965 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.544644 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.545153 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.545772 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.546271 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.546816 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.547299 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.547801 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.548310 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Tracked resource versions report: Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: pushed versions: Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: { 'AddressGroup': {'1.2'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'ConntrackHelper': {'1.0'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Log': {'1.0'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Network': {'1.1'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Port': {'1.7'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'PortForwarding': {'1.2'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'QosPolicy': {'1.10'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroup': {'1.5'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroupRule': {'1.2'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SubPort': {'1.0'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Subnet': {'1.1'}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Trunk': {'1.1'}} Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: consumer versions: Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: { DHCP agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: HyperV agent@hv-cinder-79987: {}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: L3 agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: Metadata agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: Metering agent@dv-cinder-799871-8-iscsi: {}, Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: Open vSwitch agent@dv-cinder-799871-8-iscsi: { 'AddressGroup': '1.2', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'ConntrackHelper': '1.0', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Log': '1.0', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Network': '1.1', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Port': '1.7', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'PortForwarding': '1.2', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'QosPolicy': '1.10', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroup': '1.5', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SecurityGroupRule': '1.2', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'SubPort': '1.0', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Subnet': '1.1', Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: 'Trunk': '1.1'}} Nov 18 21:00:45.549573 dv-cinder-799871-8-iscsi neutron-server[102672]: {{(pid=102672) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 18 21:00:45.575230 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a3dcc710-a0e0-4826-8d54-477016e33aa9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.647773 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a3dcc710-a0e0-4826-8d54-477016e33aa9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.657637 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Attempting to bind port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:00:45.657947 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Attempting to bind port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:00:45.663074 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Attempting to bind port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:45.693352 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:00:45.694048 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:45.695940 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.701086 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:00:45.702605 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Bound port: 0ab796a4-5d10-4a4d-a1a8-8689972297d7, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:00:45.724648 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a3dcc710-a0e0-4826-8d54-477016e33aa9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.725679 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.729325 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:45.730282 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:45.734458 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a3dcc710-a0e0-4826-8d54-477016e33aa9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.735807 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a3dcc710-a0e0-4826-8d54-477016e33aa9 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a892bc10-4c41-4ae1-a8a6-57faf68d4357 HTTP/1.1" status: 204 len: 168 time: 0.3792152 Nov 18 21:00:45.742865 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Allocated IP 172.20.0.1 (5973daa9-793c-40f5-972b-25507ee923a3/ecbb94e2-6852-471b-9339-07ed4834cbe7/3cefd565-3646-40ee-9393-8f0787133ebb) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:45.758721 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3dcc710-a0e0-4826-8d54-477016e33aa9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a892bc10-4c41-4ae1-a8a6-57faf68d4357,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:45.766126 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9d4a711-fa37-4890-a4e4-e3d87cb0114d None None] Pushing event updated for resources: {'Port': ['ID=3b9f5963-1c82-4a66-878b-8061c8718e60,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:45.771865 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:45.968588 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] For port 0ab796a4-5d10-4a4d-a1a8-8689972297d7, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:00:45.974164 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] For port 0ab796a4-5d10-4a4d-a1a8-8689972297d7, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0ab796a4-5d10-4a4d-a1a8-8689972297d7,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:00:45.985176 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.101300 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:46.154827 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0996250b-d4b3-4564-a514-5974cb8d91a7 req-73568e81-6db8-43aa-a7ef-bbbf92a42c0b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.0940704 Nov 18 21:00:46.195093 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-526d8eb2-d7b4-4840-870f-fa858b225860 None None] Pushing event updated for resources: {'Port': ['ID=0ab796a4-5d10-4a4d-a1a8-8689972297d7,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:46.256235 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.258928 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Routers {'141c8833-0a33-4ff3-bb35-3a9703fba940'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:46.263739 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['141c8833-0a33-4ff3-bb35-3a9703fba940'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:46.333197 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.486326 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] Set router 141c8833-0a33-4ff3-bb35-3a9703fba940 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:46.516375 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:40Z', 'revision_number': 3, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:46.558164 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60700) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:46.578610 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5f862751-5c34-4f4d-a3f6-0821b6b25fc0 None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:40Z', 'revision_number': 3, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:00:46.596935 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1fad1ddd-8ca5-41b5-80cf-06b4e8ce39c9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.735844 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722df428-e9b7-491f-8696-b571e3b5b49c req-7bc7f78f-66be-4fa8-aa52-e9d2bd6c5800 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 210 time: 0.4189811 Nov 18 21:00:46.780990 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Network 5973daa9-793c-40f5-972b-25507ee923a3 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:46.805069 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1fad1ddd-8ca5-41b5-80cf-06b4e8ce39c9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.816696 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1fad1ddd-8ca5-41b5-80cf-06b4e8ce39c9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.823715 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:46.838737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:46.839385 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:46.852884 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-1fad1ddd-8ca5-41b5-80cf-06b4e8ce39c9 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=8837538a77e842b6b734fe54f606ceed&name=default HTTP/1.1" status: 200 len: 2992 time: 0.2928553 Nov 18 21:00:46.855811 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60706) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:46.917422 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:41Z', 'revision_number': 3, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:47.011190 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fad1ddd-8ca5-41b5-80cf-06b4e8ce39c9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c54c4f7-adfe-4533-83a7-797602b2408f,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:47.072762 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c9c8988-2fbd-44dd-9cee-dcb3a62ab10c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:47.076311 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Pushing event updated for resources: {'Port': ['ID=3cefd565-3646-40ee-9393-8f0787133ebb,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:47.080252 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd56d2e-1fed-4d8a-9ba6-f8f0999645b0 None None] The sync data for ids ['141c8833-0a33-4ff3-bb35-3a9703fba940'] in dv-cinder-799871-8-iscsi is: [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:41Z', 'revision_number': 3, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:00:47.154866 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.62', 59524) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:47.211412 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c9c8988-2fbd-44dd-9cee-dcb3a62ab10c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:47.562368 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:47.577020 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c9c8988-2fbd-44dd-9cee-dcb3a62ab10c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:47.589086 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c9c8988-2fbd-44dd-9cee-dcb3a62ab10c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:47.593045 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-8c9c8988-2fbd-44dd-9cee-dcb3a62ab10c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1c54c4f7-adfe-4533-83a7-797602b2408f HTTP/1.1" status: 204 len: 168 time: 0.7359300 Nov 18 21:00:47.632820 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Allocated IP 172.20.0.1 (c212623b-e2b5-4f51-9cd5-a24f8a69f653/bc253697-be56-4044-aeb5-455225f5b7ab/e140da03-4af4-43e2-8e18-8669d09e9d76) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:47.641474 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-eed0c5c9-a9c9-4bb1-a4f4-d4a147b304a0 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:47.642984 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-eed0c5c9-a9c9-4bb1-a4f4-d4a147b304a0 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.62 "GET /v2.0/networks?id=f1ea2660-7fe2-437d-9b30-7d386db79f6c HTTP/1.1" status: 200 len: 810 time: 0.4868495 Nov 18 21:00:47.754709 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ff02ec2-23e4-47c2-9d31-d8d87a3d60fd req-3518d8f4-1bd5-4aec-a383-b67f8fba8a09 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.1831479 Nov 18 21:00:47.758523 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Request body: {'port': {'device_id': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c', 'admin_state_up': True, 'tenant_id': 'd84c0234ebde42a9a24ece0729b10890'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:47.806975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c9c8988-2fbd-44dd-9cee-dcb3a62ab10c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c54c4f7-adfe-4533-83a7-797602b2408f,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:47.870255 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.62', 59529) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:48.109911 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2c1c0e7b-cc79-41ee-b0b2-4a41ff5bd670 req-83cb022a-f0a9-48d2-8530-fb0f7b1aad48 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 210 time: 0.1227977 Nov 18 21:00:48.372553 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60774) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:48.392514 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-0e2e9f17-9498-4a93-9838-ae5d55f88fe0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:48.396100 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-0e2e9f17-9498-4a93-9838-ae5d55f88fe0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.5218115 Nov 18 21:00:48.403827 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3b9f5963-1c82-4a66-878b-8061c8718e60 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:48.435644 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Request body: {'port': {'device_id': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'admin_state_up': True, 'tenant_id': '05431e285025437d8783475290b4e4fc'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:48.498216 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 3b9f5963-1c82-4a66-878b-8061c8718e60 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:48.498583 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.518865 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.529659 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.543542 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Made reservation on behalf of d84c0234ebde42a9a24ece0729b10890 for: {'port': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:48.547639 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.569362 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.570256 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.642323 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.671214 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 3b9f5963-1c82-4a66-878b-8061c8718e60, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=3b9f5963-1c82-4a66-878b-8061c8718e60,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:00:48.685615 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.686485 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0ab796a4-5d10-4a4d-a1a8-8689972297d7 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:48.754559 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60796) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:48.802299 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3dc7f2df-2485-4d2a-b353-5dcdb71f6b2e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:48.932849 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=3b9f5963-1c82-4a66-878b-8061c8718e60,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:48.974436 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:48.974816 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.091220 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3dc7f2df-2485-4d2a-b353-5dcdb71f6b2e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.145236 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Pushing event updated for resources: {'Port': ['ID=3cefd565-3646-40ee-9393-8f0787133ebb,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:49.157875 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3dc7f2df-2485-4d2a-b353-5dcdb71f6b2e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.178698 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.345797 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Allocated IP 172.20.0.10 (f1ea2660-7fe2-437d-9b30-7d386db79f6c/39256260-0b56-47a0-a1ad-a05a1ac59638/3d1065d4-abc3-48ca-9275-5c415cb3466a) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:49.443718 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:49.450022 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3dc7f2df-2485-4d2a-b353-5dcdb71f6b2e admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=9d58de1e5b594ce6bb9f75e530e3263d&name=default HTTP/1.1" status: 200 len: 2993 time: 0.6931858 Nov 18 21:00:49.450022 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3dc7f2df-2485-4d2a-b353-5dcdb71f6b2e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f79277f4-e9dd-428d-9840-f9f2d23a986b,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:49.478005 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-37a2c361-4330-4b29-b681-4f5e75b26f2e req-2561df65-fc88-4521-8c46-374181da9b6b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.5485876 Nov 18 21:00:49.492971 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2cec4dfa-ffc3-4207-875d-a49db6405bc2 req-8234efe7-539c-4f02-9a21-2cd0f5c1515c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 210 time: 0.2208805 Nov 18 21:00:49.499066 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:49.540729 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60810) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:49.551910 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:49.554079 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.638730 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.708475 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 0ab796a4-5d10-4a4d-a1a8-8689972297d7, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0ab796a4-5d10-4a4d-a1a8-8689972297d7,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:00:49.719592 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.741013 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.812736 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-612e87ae-6030-45cd-a95a-605bca1fbb95 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.876385 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Pushing event updated for resources: {'Port': ['ID=e140da03-4af4-43e2-8e18-8669d09e9d76,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:49.890291 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60818) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:49.894255 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Made reservation on behalf of 05431e285025437d8783475290b4e4fc for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:00:49.901344 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:49.917041 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=0ab796a4-5d10-4a4d-a1a8-8689972297d7,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:49.983968 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.014532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Network 5973daa9-793c-40f5-972b-25507ee923a3 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:50.027578 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:50.130461 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10839991-d5e8-4c1a-90ff-389eb45d59d6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.161516 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-99b298e7-8b02-431f-98ae-86b076912e07 None None] Provisioning complete for port e140da03-4af4-43e2-8e18-8669d09e9d76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:50.163356 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-99b298e7-8b02-431f-98ae-86b076912e07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.223548 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0f97372f-973e-4a34-897e-e4d73bbc2026 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.259765 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-99b298e7-8b02-431f-98ae-86b076912e07 None None] Port e140da03-4af4-43e2-8e18-8669d09e9d76 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:00:50.341579 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3b9f5963-1c82-4a66-878b-8061c8718e60 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:50.351492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0f97372f-973e-4a34-897e-e4d73bbc2026 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.361454 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10839991-d5e8-4c1a-90ff-389eb45d59d6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.374317 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0f97372f-973e-4a34-897e-e4d73bbc2026 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.444980 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f97372f-973e-4a34-897e-e4d73bbc2026 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34e83873-ded5-449a-ac28-99dfebc50fda,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:50.456796 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.487115 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 3b9f5963-1c82-4a66-878b-8061c8718e60 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:50.488322 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.545217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.644067 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60830) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:50.661696 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0f97372f-973e-4a34-897e-e4d73bbc2026 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=aec68c11202d45f688fbefb0d035ecf9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7579410 Nov 18 21:00:50.702017 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60834) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:50.776628 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0ab796a4-5d10-4a4d-a1a8-8689972297d7 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:50.904155 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:50.904892 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:50.934305 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Pushing event updated for resources: {'Port': ['ID=3d1065d4-abc3-48ca-9275-5c415cb3466a,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:50.957818 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-721d25ff-7899-4056-92a2-8cc294f66949 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.072368 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Allocated IP 172.20.0.7 (2d6a6844-15e6-4a14-9103-24e890fa190f/fcebaf13-b181-404f-a8e5-52ddbe0c8c7c/67b470ac-d502-4785-a1b3-cabbdf1eaf77) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:00:51.076502 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-09f416c2-11f8-4a3d-af5e-18445c326add req-19d957d9-45ec-468a-9cbc-331604afe70e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.0938466 Nov 18 21:00:51.085641 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Network f1ea2660-7fe2-437d-9b30-7d386db79f6c is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:51.159117 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:51.170078 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:51.175959 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:51.176665 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.194029 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-612e87ae-6030-45cd-a95a-605bca1fbb95 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.200956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Router 141c8833-0a33-4ff3-bb35-3a9703fba940 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:00:51.262416 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227c995b-74c0-4807-a613-20bd94d185b1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.274309 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-612e87ae-6030-45cd-a95a-605bca1fbb95 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.291417 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-94a0dbb1-b002-4810-879f-f57bc60250ec tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.5777216 Nov 18 21:00:51.341848 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10839991-d5e8-4c1a-90ff-389eb45d59d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.344622 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10839991-d5e8-4c1a-90ff-389eb45d59d6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.346529 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-10839991-d5e8-4c1a-90ff-389eb45d59d6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f79277f4-e9dd-428d-9840-f9f2d23a986b HTTP/1.1" status: 204 len: 168 time: 1.8035543 Nov 18 21:00:51.347704 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-612e87ae-6030-45cd-a95a-605bca1fbb95 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=51b71f8c-173e-4660-9ce2-cc02b59ee158,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:51.454337 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.459988 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227c995b-74c0-4807-a613-20bd94d185b1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.497654 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.498365 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.558296 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-612e87ae-6030-45cd-a95a-605bca1fbb95 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3701e766101e48eaace68d03bd3fb325&name=default HTTP/1.1" status: 200 len: 2996 time: 3.1843505 Nov 18 21:00:51.570959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60844) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:51.572553 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6a725e4-0f75-4274-a960-e4f99583165d req-735739bc-ed43-49bd-85bc-65329503e93a tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:51.574525 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b6a725e4-0f75-4274-a960-e4f99583165d req-735739bc-ed43-49bd-85bc-65329503e93a tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 932 time: 0.6487317 Nov 18 21:00:51.585070 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227c995b-74c0-4807-a613-20bd94d185b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.587806 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227c995b-74c0-4807-a613-20bd94d185b1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.589009 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-227c995b-74c0-4807-a613-20bd94d185b1 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/34e83873-ded5-449a-ac28-99dfebc50fda HTTP/1.1" status: 204 len: 168 time: 0.6702929 Nov 18 21:00:51.591861 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10839991-d5e8-4c1a-90ff-389eb45d59d6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f79277f4-e9dd-428d-9840-f9f2d23a986b,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:51.708845 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b6a725e4-0f75-4274-a960-e4f99583165d req-2a3b6177-680e-4fc9-a684-ad3491099a97 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245649 Nov 18 21:00:51.709100 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-227c995b-74c0-4807-a613-20bd94d185b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34e83873-ded5-449a-ac28-99dfebc50fda,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:51.753817 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:00:51.828973 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-721d25ff-7899-4056-92a2-8cc294f66949 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.839639 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-721d25ff-7899-4056-92a2-8cc294f66949 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.891464 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-721d25ff-7899-4056-92a2-8cc294f66949 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a9f9037637cb4565a7058312cbef2f78&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2398264 Nov 18 21:00:51.891464 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60852) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:51.933255 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-721d25ff-7899-4056-92a2-8cc294f66949 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9c8ab93-1789-4f7e-a867-0c6b24173c26,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:51.969326 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-217b717c-c0a4-4d1f-afd3-d3413135e8ba admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:51.999668 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-217b717c-c0a4-4d1f-afd3-d3413135e8ba admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.101183 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-217b717c-c0a4-4d1f-afd3-d3413135e8ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.104341 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-217b717c-c0a4-4d1f-afd3-d3413135e8ba admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.105527 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-217b717c-c0a4-4d1f-afd3-d3413135e8ba admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d9c8ab93-1789-4f7e-a867-0c6b24173c26 HTTP/1.1" status: 204 len: 168 time: 0.2133965 Nov 18 21:00:52.120933 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-217b717c-c0a4-4d1f-afd3-d3413135e8ba admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9c8ab93-1789-4f7e-a867-0c6b24173c26,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:52.138961 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Pushing event updated for resources: {'Port': ['ID=e140da03-4af4-43e2-8e18-8669d09e9d76,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:52.151386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:00:52.174947 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Sync routers for ids ['141c8833-0a33-4ff3-bb35-3a9703fba940'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:00:52.197576 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3420d1af-5ad2-40d9-8f19-8a9b589f5413 admin admin] 10.222.0.61 "PUT /v2.0/routers/141c8833-0a33-4ff3-bb35-3a9703fba940/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.1349859 Nov 18 21:00:52.204893 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Routers {'141c8833-0a33-4ff3-bb35-3a9703fba940'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:52.205541 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['141c8833-0a33-4ff3-bb35-3a9703fba940'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:52.236885 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.297343 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:52.301612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1aa9cb58-0509-4958-af3e-4bd26f9bd537 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.305608 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:52.439847 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5ab33eac-7e10-42eb-8e8d-4587930bdb69 req-dde50bca-951c-41b7-a72b-9b54f140ed6e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.1395409 Nov 18 21:00:52.462086 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60866) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:52.486471 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c894e96c-822e-4c9a-a1c3-88672ab2da52 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.536174 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Set router 141c8833-0a33-4ff3-bb35-3a9703fba940 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:52.675810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:00:52.698592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1aa9cb58-0509-4958-af3e-4bd26f9bd537 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.705254 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c894e96c-822e-4c9a-a1c3-88672ab2da52 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.715039 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c894e96c-822e-4c9a-a1c3-88672ab2da52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.814626 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c894e96c-822e-4c9a-a1c3-88672ab2da52 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=eda92af94e144c2b83253991744ca932&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3457835 Nov 18 21:00:52.822401 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60872) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:52.848064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-45498731-69b4-4b67-95e4-5656d3255008 None None] Provisioning complete for port e140da03-4af4-43e2-8e18-8669d09e9d76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:52.851776 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-45498731-69b4-4b67-95e4-5656d3255008 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.923198 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:52.997292 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-45498731-69b4-4b67-95e4-5656d3255008 None None] Port e140da03-4af4-43e2-8e18-8669d09e9d76 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:00:53.043080 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c894e96c-822e-4c9a-a1c3-88672ab2da52 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=272abec6-f14b-452f-aaca-3df8f277ec85,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:53.066404 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e64f64c-c624-4285-a646-993d51d7c73f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.088967 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feb6c86e-5456-4b4b-8acf-f6ad444998a6 req-8c89398d-c935-4b55-bbf9-2431e921a184 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:53.090597 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-feb6c86e-5456-4b4b-8acf-f6ad444998a6 req-8c89398d-c935-4b55-bbf9-2431e921a184 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 932 time: 0.1719790 Nov 18 21:00:53.109191 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e64f64c-c624-4285-a646-993d51d7c73f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.147874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Network 2d6a6844-15e6-4a14-9103-24e890fa190f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:00:53.244769 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-feb6c86e-5456-4b4b-8acf-f6ad444998a6 req-2a39a160-8660-42f4-bb64-43f4fdb91b05 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1375470 Nov 18 21:00:53.271198 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:47Z', 'revision_number': 4, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '3cefd565-3646-40ee-9393-8f0787133ebb', 'name': '', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'mac_address': 'fa:16:3e:52:5d:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:47Z', 'revision_number': 2, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'subnets': [{'id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:53.272841 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:00:53.283041 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-f46dc23b-b01a-4465-a797-dafdd57224ab tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:00:53.285824 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-f46dc23b-b01a-4465-a797-dafdd57224ab tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0382488 Nov 18 21:00:53.286618 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:00:53.287238 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e64f64c-c624-4285-a646-993d51d7c73f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.314310 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e64f64c-c624-4285-a646-993d51d7c73f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.320311 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6e64f64c-c624-4285-a646-993d51d7c73f admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/272abec6-f14b-452f-aaca-3df8f277ec85 HTTP/1.1" status: 204 len: 168 time: 0.4882164 Nov 18 21:00:53.331993 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:00:53.341922 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:53.342993 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e64f64c-c624-4285-a646-993d51d7c73f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=272abec6-f14b-452f-aaca-3df8f277ec85,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:53.343353 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:00:53.354938 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:53.365013 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Checking router: 141c8833-0a33-4ff3-bb35-3a9703fba940 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:00:53.365809 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Updating router 141c8833-0a33-4ff3-bb35-3a9703fba940 port 3cefd565-3646-40ee-9393-8f0787133ebb binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:00:53.376019 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:53.379986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.397584 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-522a20e7-87fc-498f-bbf1-13af1f1e16c9 admin admin] 10.222.0.61 "PUT /v2.0/routers/def0e3d1-c7be-4250-990a-3b6d3d56f9a0/add_router_interface HTTP/1.1" status: 200 len: 503 time: 10.2195158 Nov 18 21:00:53.415730 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.453947 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event updated for resources: {'Port': ['ID=67b470ac-d502-4785-a1b3-cabbdf1eaf77,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:53.486686 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1aa9cb58-0509-4958-af3e-4bd26f9bd537 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.496756 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1aa9cb58-0509-4958-af3e-4bd26f9bd537 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:53.501553 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1aa9cb58-0509-4958-af3e-4bd26f9bd537 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/51b71f8c-173e-4660-9ce2-cc02b59ee158 HTTP/1.1" status: 204 len: 168 time: 1.9243309 Nov 18 21:00:53.530155 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1aa9cb58-0509-4958-af3e-4bd26f9bd537 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=51b71f8c-173e-4660-9ce2-cc02b59ee158,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:53.551559 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-143862a7-2dee-47f6-8db0-b45d13473181 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 5.1270154 Nov 18 21:00:53.650830 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:53.688669 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3a5a9e-e7d5-459d-ae57-b0fb6a6613bf req-9b92eb57-72f6-41de-8996-f2117b981b04 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:53.690416 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f3a5a9e-e7d5-459d-ae57-b0fb6a6613bf req-9b92eb57-72f6-41de-8996-f2117b981b04 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 931 time: 0.1190913 Nov 18 21:00:53.814532 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f3a5a9e-e7d5-459d-ae57-b0fb6a6613bf req-c21b9978-0ab6-4c06-bebc-8b72dfc6a7df tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1141255 Nov 18 21:00:54.057786 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:51Z', 'revision_number': 2, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:54.120307 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.128945 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:00:54.129164 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.129883 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Updating router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 port e140da03-4af4-43e2-8e18-8669d09e9d76 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:00:54.155517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-e85dd4c6-3690-494f-93e1-428cc80a52d0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:54.171469 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-e85dd4c6-3690-494f-93e1-428cc80a52d0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 819 time: 0.2391541 Nov 18 21:00:54.202860 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-404db447-7c5e-4488-a74b-6b08f8f0e200 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/quotas/5c11bd4ad5214d279c477c233d05b6d3 HTTP/1.1" status: 200 len: 375 time: 0.0303771 Nov 18 21:00:54.209664 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.363588 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2352731c-e7db-463f-b067-5c791756a887 None None] Pushing event updated for resources: {'Port': ['ID=3cefd565-3646-40ee-9393-8f0787133ebb,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:54.364195 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-75c0b369-e0ac-43f8-8ab5-e9713ef4253c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1599133 Nov 18 21:00:54.489515 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-ef46fc21-5948-4888-9bb0-8291c9ec3a70 service neutron] 10.222.0.61 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1245277 Nov 18 21:00:54.550500 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Attempting to bind port 3cefd565-3646-40ee-9393-8f0787133ebb on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:00:54.551699 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Attempting to bind port 3cefd565-3646-40ee-9393-8f0787133ebb by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:00:54.552081 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Attempting to bind port 3cefd565-3646-40ee-9393-8f0787133ebb on network 5973daa9-793c-40f5-972b-25507ee923a3 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:54.564160 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:00:54.564582 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Checking segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:54.565026 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.565436 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Bound using segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:00:54.567119 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Bound port: 3cefd565-3646-40ee-9393-8f0787133ebb, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:00:54.569188 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.691826 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-3f98ad50-8ab9-474f-9989-ee1c90339767 service neutron] 10.222.0.61 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2012193 Nov 18 21:00:54.716630 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Request body: {'port': {'device_id': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:54.729237 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] For port 3cefd565-3646-40ee-9393-8f0787133ebb, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:00:54.733557 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] For port 3cefd565-3646-40ee-9393-8f0787133ebb, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=3cefd565-3646-40ee-9393-8f0787133ebb,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:00:54.753415 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Request body: {'port': {'device_id': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:54.757556 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.905769 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Routers {'141c8833-0a33-4ff3-bb35-3a9703fba940'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:54.906573 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['141c8833-0a33-4ff3-bb35-3a9703fba940'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:54.933557 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:54.987641 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:55.006000 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:55.016642 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2352731c-e7db-463f-b067-5c791756a887 None None] Pushing event updated for resources: {'Port': ['ID=3cefd565-3646-40ee-9393-8f0787133ebb,revision_number=4']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:55.093851 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:55.404539 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] Set router 141c8833-0a33-4ff3-bb35-3a9703fba940 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:55.458574 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3471521-2316-4036-97f8-6ec9dda20475 req-94e39071-3a24-4a87-8be3-1afc863b842d tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:55.470187 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3471521-2316-4036-97f8-6ec9dda20475 req-94e39071-3a24-4a87-8be3-1afc863b842d tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 932 time: 0.3400855 Nov 18 21:00:55.485379 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Attempting to bind port e140da03-4af4-43e2-8e18-8669d09e9d76 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:00:55.487642 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Attempting to bind port e140da03-4af4-43e2-8e18-8669d09e9d76 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:00:55.488036 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Attempting to bind port e140da03-4af4-43e2-8e18-8669d09e9d76 on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:55.502893 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723ae9fa-30a3-46b9-b0e9-c5cf50bdedaa None None] Pushing event updated for resources: {'Port': ['ID=e140da03-4af4-43e2-8e18-8669d09e9d76,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:55.521591 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:00:55.522746 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Checking segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:55.525045 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:55.528599 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Bound using segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:00:55.529666 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Bound port: e140da03-4af4-43e2-8e18-8669d09e9d76, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:00:55.530419 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:55.811772 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 60948) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:55.845996 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-7d25ec57-d2b0-446f-a1c5-ae6ce6d68a98 None None] Provisioning complete for port e140da03-4af4-43e2-8e18-8669d09e9d76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:55.845996 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7d25ec57-d2b0-446f-a1c5-ae6ce6d68a98 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:55.970566 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-7d25ec57-d2b0-446f-a1c5-ae6ce6d68a98 None None] Port e140da03-4af4-43e2-8e18-8669d09e9d76 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:00:55.983942 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] For port e140da03-4af4-43e2-8e18-8669d09e9d76, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:00:56.019918 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] For port e140da03-4af4-43e2-8e18-8669d09e9d76, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=e140da03-4af4-43e2-8e18-8669d09e9d76,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:00:56.044701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:56.137331 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:47Z', 'revision_number': 4, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '3cefd565-3646-40ee-9393-8f0787133ebb', 'name': '', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'mac_address': 'fa:16:3e:52:5d:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:54Z', 'revision_number': 4, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'subnets': [{'id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:56.216034 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60954) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:56.232305 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'security_group': {'name': 'tempest-securitygroup--2015243257', 'description': 'tempest-description--1584656858'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:56.296468 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723ae9fa-30a3-46b9-b0e9-c5cf50bdedaa None None] Pushing event updated for resources: {'Port': ['ID=e140da03-4af4-43e2-8e18-8669d09e9d76,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:56.308806 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-328898d7-677f-44bc-80a2-bbca2e8999d2 None None] The sync data for ids ['141c8833-0a33-4ff3-bb35-3a9703fba940'] in dv-cinder-799871-8-iscsi is: [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:47Z', 'revision_number': 4, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '3cefd565-3646-40ee-9393-8f0787133ebb', 'name': '', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'mac_address': 'fa:16:3e:52:5d:2d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_interface', 'standard_attr_id': 88, 'fixed_ips': [{'subnet_id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:54Z', 'revision_number': 4, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'subnets': [{'id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:00:56.403250 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:00:56.403965 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:00:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:56.560415 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:56.626203 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7f8ec823-9cf9-4f24-8950-a44da0c8a215 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:56.839065 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3471521-2316-4036-97f8-6ec9dda20475 req-e4a74036-f321-47d7-aba4-9a0b043d87fb tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.3650334 Nov 18 21:00:56.911435 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f868e0-5499-4bc2-9e41-0a07102bdf50 req-57bc394a-532b-4838-a799-a9362f6e746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:56.921683 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f2f868e0-5499-4bc2-9e41-0a07102bdf50 req-57bc394a-532b-4838-a799-a9362f6e746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 931 time: 0.3714099 Nov 18 21:00:56.975057 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-f4c114a6-87bc-4047-a6d8-408f3d2581ae None None] Provisioning complete for port e140da03-4af4-43e2-8e18-8669d09e9d76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:56.975705 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f4c114a6-87bc-4047-a6d8-408f3d2581ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.075778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:00:57.214888 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.235132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.354847 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8e011f1b-5d81-4e4d-93a0-6604f382a6d0 req-195d63d5-1eb7-4dfc-b2a4-7d1453871111 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 210 time: 0.2486029 Nov 18 21:00:57.467170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.470934 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.2448444 Nov 18 21:00:57.487322 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 60976) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:57.503027 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'security_group_rule': {'security_group_id': '41378fa0-8beb-4fcf-8751-adebc0223629', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:57.570628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfc01b4b-42b1-465e-8faf-2fa1baf4c826 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'SecurityGroup': ['ID=41378fa0-8beb-4fcf-8751-adebc0223629,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:57.632598 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.638487 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 67b470ac-d502-4785-a1b3-cabbdf1eaf77 {{(pid=102670) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:00:57.670729 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.754933 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.provisioning_blocks [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Transition to ACTIVE for port object 67b470ac-d502-4785-a1b3-cabbdf1eaf77 will not be triggered until provisioned by entity L2. {{(pid=102670) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:00:57.796355 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f2f868e0-5499-4bc2-9e41-0a07102bdf50 req-a18c19bf-d0cd-495b-9b45-87de496ca586 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8725812 Nov 18 21:00:57.796704 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:57.838975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7f8ec823-9cf9-4f24-8950-a44da0c8a215 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.037163 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7f8ec823-9cf9-4f24-8950-a44da0c8a215 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.271496 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f4c114a6-87bc-4047-a6d8-408f3d2581ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.312786 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.336344 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Pushing event updated for resources: {'Port': ['ID=67b470ac-d502-4785-a1b3-cabbdf1eaf77,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:58.345146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3d1065d4-abc3-48ca-9275-5c415cb3466a {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:00:58.364547 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.420349 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.426238 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-f4c114a6-87bc-4047-a6d8-408f3d2581ae None None] For port e140da03-4af4-43e2-8e18-8669d09e9d76, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=e140da03-4af4-43e2-8e18-8669d09e9d76,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:00:58.461589 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=bab7c585-0bef-40eb-85e4-788d478bed9a,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:58.485583 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7f8ec823-9cf9-4f24-8950-a44da0c8a215 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=352b01042e994aa2b7b380b9d697dc95&name=default HTTP/1.1" status: 200 len: 2996 time: 1.9357669 Nov 18 21:00:58.486557 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7f8ec823-9cf9-4f24-8950-a44da0c8a215 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e8609428-77ff-4be1-a9b9-51f43522f0f4,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:58.503277 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 32780) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:58.505855 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3cefd565-3646-40ee-9393-8f0787133ebb up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:00:58.517696 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:55Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:00:58.650302 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Transition to ACTIVE for port object 3d1065d4-abc3-48ca-9275-5c415cb3466a will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:00:58.651446 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87922c3f-5511-41a8-8583-1e615dfd93f1 req-5c835efa-932a-4f4f-a564-33fa3507b304 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:58.659361 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-87922c3f-5511-41a8-8583-1e615dfd93f1 req-5c835efa-932a-4f4f-a564-33fa3507b304 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 932 time: 0.5988758 Nov 18 21:00:58.687978 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.692535 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9e8b558e-0a23-48b9-8442-cccab1323f2d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.1941965 Nov 18 21:00:58.693630 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 32782) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:00:58.709172 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Attempting to bind port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:00:58.709504 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Attempting to bind port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:00:58.709682 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'security_group_rule': {'security_group_id': '41378fa0-8beb-4fcf-8751-adebc0223629', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:00:58.709852 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Attempting to bind port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:58.752012 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 on network 2d6a6844-15e6-4a14-9103-24e890fa190f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:00:58.752385 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Attempting to bind port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:00:58.755689 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f4c114a6-87bc-4047-a6d8-408f3d2581ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.772530 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-08d1d7ec-a4ea-426e-88bd-9d859f1913a7 None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:55Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:00:58.798015 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:00:58.798318 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Checking segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:00:58.798722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Bound using segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:00:58.799207 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Bound port: 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:00:58.799537 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.803483 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:58.857646 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-87922c3f-5511-41a8-8583-1e615dfd93f1 req-d9e337b8-145c-4eb9-a8aa-0965a12a6da1 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1972034 Nov 18 21:00:59.078167 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] For port 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host hv-cinder-79987, cleared binding levels {{(pid=102670) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:00:59.084078 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4c114a6-87bc-4047-a6d8-408f3d2581ae None None] Pushing event updated for resources: {'Port': ['ID=e140da03-4af4-43e2-8e18-8669d09e9d76,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:59.122962 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 3cefd565-3646-40ee-9393-8f0787133ebb triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:00:59.122962 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.123118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Pushing event updated for resources: {'Port': ['ID=3d1065d4-abc3-48ca-9275-5c415cb3466a,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:59.172535 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.183118 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] For port 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102670) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:00:59.206402 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.260319 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:59.261096 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.264286 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] 10.222.0.62 "PUT /v2.0/ports/67b470ac-d502-4785-a1b3-cabbdf1eaf77 HTTP/1.1" status: 200 len: 1093 time: 5.5394146 Nov 18 21:00:59.268203 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'tag': '67b470ac-d502-4785-a1b3-cabbdf1eaf77'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:00:59.355579 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5d689345-85fd-4bbe-940d-3c16b2e8d2e0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.435346 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.445520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.461199 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-103107ba-22b3-433c-8b66-751e960ac596 req-e4a81270-99e6-4410-ae7f-182b7266a343 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:59.473180 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-103107ba-22b3-433c-8b66-751e960ac596 req-e4a81270-99e6-4410-ae7f-182b7266a343 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.4661524 Nov 18 21:00:59.487386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-69fbbe3d-cf96-4674-b4bb-a250379eb589 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:00:59.504518 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-69fbbe3d-cf96-4674-b4bb-a250379eb589 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 819 time: 1.4560044 Nov 18 21:00:59.511730 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.576823 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-300e369f-0afc-4e7c-b617-67594a2c603c service neutron] Pushing event updated for resources: {'Port': ['ID=67b470ac-d502-4785-a1b3-cabbdf1eaf77,revision_number=3']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:59.603669 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=ba88b59e-d12c-41b6-849d-bf56bf26c6fa,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:59.634569 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 3cefd565-3646-40ee-9393-8f0787133ebb, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=3cefd565-3646-40ee-9393-8f0787133ebb,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:00:59.661924 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-103107ba-22b3-433c-8b66-751e960ac596 req-70213725-c57f-498a-b541-4e87e4c837de tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1859169 Nov 18 21:00:59.664853 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.759775 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5d689345-85fd-4bbe-940d-3c16b2e8d2e0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.895817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=3cefd565-3646-40ee-9393-8f0787133ebb,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:00:59.923812 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5d689345-85fd-4bbe-940d-3c16b2e8d2e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.948475 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5d689345-85fd-4bbe-940d-3c16b2e8d2e0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:00:59.950327 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5d689345-85fd-4bbe-940d-3c16b2e8d2e0 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/e8609428-77ff-4be1-a9b9-51f43522f0f4 HTTP/1.1" status: 204 len: 168 time: 1.4273975 Nov 18 21:01:00.047890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-ff5e161d-c4ea-4634-84df-8afb7056bbb8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/quotas/5c11bd4ad5214d279c477c233d05b6d3 HTTP/1.1" status: 200 len: 375 time: 0.5427005 Nov 18 21:01:00.104308 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.105190 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecdf8d06-b287-4f8d-9f49-57baa27e0c93 req-b3d7fa15-71e3-41ed-b084-cda54c60229e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:00.109917 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3ab997ce-ef41-44fe-8efc-eba8df5da61a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4106529 Nov 18 21:01:00.111368 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Attempting to bind port 3d1065d4-abc3-48ca-9275-5c415cb3466a on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:01:00.111867 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Attempting to bind port 3d1065d4-abc3-48ca-9275-5c415cb3466a by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '1822c8a3-e235-4644-8a58-074d8932baed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:01:00.112383 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Attempting to bind port 3d1065d4-abc3-48ca-9275-5c415cb3466a on network f1ea2660-7fe2-437d-9b30-7d386db79f6c {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:00.114976 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d689345-85fd-4bbe-940d-3c16b2e8d2e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e8609428-77ff-4be1-a9b9-51f43522f0f4,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:00.115467 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ecdf8d06-b287-4f8d-9f49-57baa27e0c93 req-b3d7fa15-71e3-41ed-b084-cda54c60229e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.0823576 Nov 18 21:01:00.117095 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 32820) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:00.133430 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 32822) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:00.160818 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:00.175048 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd481df3-f56b-4fbd-befa-5bf2abbebc18" -d '{"events": [{"name": "network-changed", "server_uuid": "372b6983-3b61-4ecd-a186-2a7e7adbcf37", "tag": "67b470ac-d502-4785-a1b3-cabbdf1eaf77"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:00.177247 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Port 3d1065d4-abc3-48ca-9275-5c415cb3466a on network f1ea2660-7fe2-437d-9b30-7d386db79f6c not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:01:00.177568 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Attempting to bind port 3d1065d4-abc3-48ca-9275-5c415cb3466a on network f1ea2660-7fe2-437d-9b30-7d386db79f6c {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:00.195371 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:01:00.195748 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Checking segment: {'id': '1822c8a3-e235-4644-8a58-074d8932baed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:00.197078 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Bound using segment: {'id': '1822c8a3-e235-4644-8a58-074d8932baed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:01:00.197682 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Bound port: 3d1065d4-abc3-48ca-9275-5c415cb3466a, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '1822c8a3-e235-4644-8a58-074d8932baed', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 622, 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:01:00.198034 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.233384 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-ae26604a-10bc-4481-a82c-cd5f875838b9 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&fields=id HTTP/1.1" status: 200 len: 255 time: 0.1155617 Nov 18 21:01:00.314745 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] For port 3d1065d4-abc3-48ca-9275-5c415cb3466a, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:01:00.320650 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] For port 3d1065d4-abc3-48ca-9275-5c415cb3466a, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a,segment=NetworkSegment(1822c8a3-e235-4644-8a58-074d8932baed),segment_id=1822c8a3-e235-4644-8a58-074d8932baed)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:01:00.328795 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ecdf8d06-b287-4f8d-9f49-57baa27e0c93 req-eb791616-9d5f-4cc1-b304-6151bafe315b tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2124226 Nov 18 21:01:00.363759 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.447991 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device e140da03-4af4-43e2-8e18-8669d09e9d76 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:00.451248 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.525785 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port e140da03-4af4-43e2-8e18-8669d09e9d76 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:00.526578 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.538290 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:00.538918 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.541018 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] 10.222.0.62 "PUT /v2.0/ports/3d1065d4-abc3-48ca-9275-5c415cb3466a HTTP/1.1" status: 200 len: 1094 time: 6.8186102 Nov 18 21:01:00.541487 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'tag': '3d1065d4-abc3-48ca-9275-5c415cb3466a'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:00.559324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.704762 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Allocated IP 172.27.3.120 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/efc13cab-bca4-4f27-bd41-4771fddb9fcc) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:00.718970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3cefd565-3646-40ee-9393-8f0787133ebb up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:00.838685 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-159d8b4e-f06e-445e-8a82-e2c8ed913819 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.865435 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 3cefd565-3646-40ee-9393-8f0787133ebb triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:00.866007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:00.938427 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b47ae404-1c47-4b6c-90c5-7a2f21f714e7 service neutron] Pushing event updated for resources: {'Port': ['ID=3d1065d4-abc3-48ca-9275-5c415cb3466a,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:01.006270 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-f954fe8e-38f1-4ba6-aed0-ff5fc757f19e service neutron] 10.222.0.61 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6664810 Nov 18 21:01:01.021472 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.111500 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.207994 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:01.244968 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:01.303248 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:01.315082 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1a16a242-ca29-46cd-9849-9ea4a65ce189" -d '{"events": [{"name": "network-changed", "server_uuid": "b957f670-6b5a-4acf-883d-2111d15606e6", "tag": "3d1065d4-abc3-48ca-9275-5c415cb3466a"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:01.327974 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'Port': ['ID=efc13cab-bca4-4f27-bd41-4771fddb9fcc,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:01.400307 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-ec605951-a274-49a3-ae8d-7b21f482a2b1 service neutron] 10.222.0.61 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3839197 Nov 18 21:01:01.430308 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-159d8b4e-f06e-445e-8a82-e2c8ed913819 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.451888 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-159d8b4e-f06e-445e-8a82-e2c8ed913819 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.551699 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-159d8b4e-f06e-445e-8a82-e2c8ed913819 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c092686577024d199e86d84385659dce&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4154999 Nov 18 21:01:01.555433 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 32856) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:01.695261 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-159d8b4e-f06e-445e-8a82-e2c8ed913819 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14c547c8-c5d8-4a13-819a-dd461b4cf1fb,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:01.785452 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.810933 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5f5ea4f4-4f38-4e6f-95e1-e3a653a9806b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.826949 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4e265fb6-32b8-4f5c-bfdf-b0fcbabaabe6 x-openstack-request-id: req-4e265fb6-32b8-4f5c-bfdf-b0fcbabaabe6 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:01.827393 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "372b6983-3b61-4ecd-a186-2a7e7adbcf37", "tag": "67b470ac-d502-4785-a1b3-cabbdf1eaf77", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:01.827784 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4e265fb6-32b8-4f5c-bfdf-b0fcbabaabe6 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:01.834718 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'tag': '67b470ac-d502-4785-a1b3-cabbdf1eaf77', 'status': 'completed', 'code': 200} Nov 18 21:01:01.866608 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5f5ea4f4-4f38-4e6f-95e1-e3a653a9806b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.905138 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:01.908371 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d99162d-25e1-44a8-ad70-aea89767e08b req-632087b8-9663-49cc-a8ec-c0fec6ed79f4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:01.916193 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0d99162d-25e1-44a8-ad70-aea89767e08b req-632087b8-9663-49cc-a8ec-c0fec6ed79f4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.1314046 Nov 18 21:01:02.070655 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0d99162d-25e1-44a8-ad70-aea89767e08b req-33e92abf-b49e-439c-b027-ae12be094fcf tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1351700 Nov 18 21:01:02.073515 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5f5ea4f4-4f38-4e6f-95e1-e3a653a9806b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.077377 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5f5ea4f4-4f38-4e6f-95e1-e3a653a9806b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.082886 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5f5ea4f4-4f38-4e6f-95e1-e3a653a9806b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/14c547c8-c5d8-4a13-819a-dd461b4cf1fb HTTP/1.1" status: 204 len: 168 time: 0.5228977 Nov 18 21:01:02.093567 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f5ea4f4-4f38-4e6f-95e1-e3a653a9806b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14c547c8-c5d8-4a13-819a-dd461b4cf1fb,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:02.217334 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f17d856c-0a9b-4afd-9912-6916de3dea83 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.250707 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.264988 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.363185 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.385927 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f6fcdce6-0633-4ec3-be32-9ad635d3fdc3 x-openstack-request-id: req-f6fcdce6-0633-4ec3-be32-9ad635d3fdc3 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:02.388294 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b957f670-6b5a-4acf-883d-2111d15606e6", "tag": "3d1065d4-abc3-48ca-9275-5c415cb3466a", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:02.388823 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f6fcdce6-0633-4ec3-be32-9ad635d3fdc3 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:02.389732 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'tag': '3d1065d4-abc3-48ca-9275-5c415cb3466a', 'status': 'completed', 'code': 200} Nov 18 21:01:02.411097 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-561eeee9-bd32-49b8-8ff9-731ace2010da req-ae083d76-14c7-4c9e-bd0d-d8899a660e9e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:02.425464 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-561eeee9-bd32-49b8-8ff9-731ace2010da req-ae083d76-14c7-4c9e-bd0d-d8899a660e9e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.1935101 Nov 18 21:01:02.437580 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.469353 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 2.3304038 Nov 18 21:01:02.494226 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15db1b85-e38b-42c9-b49f-c933cd9bc341 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'Port': ['ID=efc13cab-bca4-4f27-bd41-4771fddb9fcc,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:02.534444 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-19bc08d2-ad59-40a2-b6ba-d1f8e2525418 req-7780e77b-589c-4525-83a1-029823b843af tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.0395126 Nov 18 21:01:02.567844 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-561eeee9-bd32-49b8-8ff9-731ace2010da req-16e88791-7f12-4fa8-8587-3090602f265e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1405375 Nov 18 21:01:02.759743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 32896) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:02.782994 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8cfbbfc9-c577-403e-a3fd-5170ffc0e989 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:02.992508 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-76b6db37-af53-4de7-997c-aeee74bb2255 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--2015243257&fields=id&tenant_id=d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 267 time: 0.1220458 Nov 18 21:01:03.007124 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8cfbbfc9-c577-403e-a3fd-5170ffc0e989 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:03.031027 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8cfbbfc9-c577-403e-a3fd-5170ffc0e989 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:03.116588 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8cfbbfc9-c577-403e-a3fd-5170ffc0e989 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=5bdeabf7802c48009e180454e5653bea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3517621 Nov 18 21:01:03.122433 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 32914) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:03.147423 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cfbbfc9-c577-403e-a3fd-5170ffc0e989 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb7a8e38-e9a8-43a6-901f-355f9dc84c7f,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:03.249261 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-775b4db8-b50e-4620-a054-55ba06552145 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:03.256489 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-775b4db8-b50e-4620-a054-55ba06552145 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 816 time: 0.2471578 Nov 18 21:01:03.279790 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-0d432ba3-a003-44f4-ac32-b840c2a4a750 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/quotas/d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 375 time: 0.0215771 Nov 18 21:01:03.337654 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-feca39ea-1453-4026-8617-a2d9527c3520 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:03.384892 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da22035d-ae37-44d0-b759-217d9d59ee2c req-57a8cdc0-636c-4ad7-9393-aa8fb715a704 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:03.394054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-da22035d-ae37-44d0-b759-217d9d59ee2c req-57a8cdc0-636c-4ad7-9393-aa8fb715a704 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.1698954 Nov 18 21:01:03.443870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-feca39ea-1453-4026-8617-a2d9527c3520 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:03.453341 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-a98ce41f-bda9-4b66-9393-8745ce61c53f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1630135 Nov 18 21:01:03.530409 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-da22035d-ae37-44d0-b759-217d9d59ee2c req-ec3d4ccd-ec7d-4f8e-8fc0-5c92e3e09570 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1352952 Nov 18 21:01:03.558328 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-feca39ea-1453-4026-8617-a2d9527c3520 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:03.566051 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-feca39ea-1453-4026-8617-a2d9527c3520 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:03.594580 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-feca39ea-1453-4026-8617-a2d9527c3520 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/cb7a8e38-e9a8-43a6-901f-355f9dc84c7f HTTP/1.1" status: 204 len: 168 time: 0.4645269 Nov 18 21:01:03.629310 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-feca39ea-1453-4026-8617-a2d9527c3520 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb7a8e38-e9a8-43a6-901f-355f9dc84c7f,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:03.718965 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-66d8c177-08ce-4950-a637-a4b90eb68874 service neutron] 10.222.0.61 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2265317 Nov 18 21:01:03.747537 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fd2f6015-5720-4902-888c-16f1e42de959 req-d577e9e5-bde3-4173-9c8b-b126ef244f8e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.0673451 Nov 18 21:01:03.990614 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90f7f32-790a-473c-b436-96006d503c9b req-e0a0268a-347f-4fca-8b6c-6149aabd12f0 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:03.995089 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e90f7f32-790a-473c-b436-96006d503c9b req-e0a0268a-347f-4fca-8b6c-6149aabd12f0 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.1156013 Nov 18 21:01:04.065635 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-5b08561e-9567-4b61-a7c5-a61d36ae8845 service neutron] 10.222.0.61 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3254533 Nov 18 21:01:04.070368 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e90f7f32-790a-473c-b436-96006d503c9b req-8cb7aee6-85d2-4e32-89d6-0f1a3a31d6cf tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0632763 Nov 18 21:01:04.360506 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-971d0ae0-9223-43e5-8a0c-1005c81ab139 req-071e7990-9406-49b6-940a-1414156329ec tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.0507371 Nov 18 21:01:04.638887 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8bda00cd-3783-4a8c-9339-19a9af0329bd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:04.768596 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-848ed74e-5e37-4e65-972c-eb88a162d39a req-4020788b-03ce-4dcc-8921-d3c9c386c62e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:04.787488 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-848ed74e-5e37-4e65-972c-eb88a162d39a req-4020788b-03ce-4dcc-8921-d3c9c386c62e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.1277468 Nov 18 21:01:04.954804 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-848ed74e-5e37-4e65-972c-eb88a162d39a req-c67cbb54-ae75-4d43-b1ab-5a795f1ed86f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1663339 Nov 18 21:01:05.125696 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7061f077-dfa8-49af-a0a1-7541b52a686a req-87b868bd-0f8c-4282-b360-356855d93c20 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.1143272 Nov 18 21:01:05.132098 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd481df3-f56b-4fbd-befa-5bf2abbebc18 req-8a8f0a26-1a2b-42d9-aea8-e4c2b1161a4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:05.134819 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fd481df3-f56b-4fbd-befa-5bf2abbebc18 req-8a8f0a26-1a2b-42d9-aea8-e4c2b1161a4e service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 1096 time: 0.2488506 Nov 18 21:01:05.149539 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a16a242-ca29-46cd-9849-9ea4a65ce189 req-fa8d1bbe-bb37-409d-b9db-61fbe7cb4e97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:05.155832 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1a16a242-ca29-46cd-9849-9ea4a65ce189 req-fa8d1bbe-bb37-409d-b9db-61fbe7cb4e97 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d84c0234ebde42a9a24ece0729b10890&device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 1097 time: 0.1914034 Nov 18 21:01:05.410233 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.62', 59547) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:05.732017 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81cf6112-1323-4fad-8fb9-6dd4ef147bd2 req-c3c61768-55e2-4d60-bbe9-a0d390923700 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:05.757472 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81cf6112-1323-4fad-8fb9-6dd4ef147bd2 req-c3c61768-55e2-4d60-bbe9-a0d390923700 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.2376785 Nov 18 21:01:05.818430 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a16a242-ca29-46cd-9849-9ea4a65ce189 req-ac683180-4bb7-4c1d-83d7-35b95205673b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:05.821087 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1a16a242-ca29-46cd-9849-9ea4a65ce189 req-ac683180-4bb7-4c1d-83d7-35b95205673b service neutron] 10.222.0.62 "GET /v2.0/networks?tenant_id=d84c0234ebde42a9a24ece0729b10890&shared=False HTTP/1.1" status: 200 len: 911 time: 0.6566491 Nov 18 21:01:05.930130 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bd0aee8c-d060-4c89-931a-76a243dda7f0 req-11c4c932-525c-48d0-aade-3aabf88fd9bd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.3993165 Nov 18 21:01:06.017108 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:06.047771 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd481df3-f56b-4fbd-befa-5bf2abbebc18 req-d44a9740-63a9-4a82-a272-1d81c3d371e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.052211 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fd481df3-f56b-4fbd-befa-5bf2abbebc18 req-d44a9740-63a9-4a82-a272-1d81c3d371e0 service neutron] 10.222.0.62 "GET /v2.0/networks?tenant_id=05431e285025437d8783475290b4e4fc&shared=False HTTP/1.1" status: 200 len: 915 time: 0.8997881 Nov 18 21:01:06.123307 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.62', 59551) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:06.210653 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81cf6112-1323-4fad-8fb9-6dd4ef147bd2 req-1a36a04e-93d1-4a63-857c-aba7441c0f6a tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4519830 Nov 18 21:01:06.344013 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-944b5afd-693c-4df0-9b8e-7264c669f49f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.350458 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-944b5afd-693c-4df0-9b8e-7264c669f49f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 819 time: 0.9362524 Nov 18 21:01:06.381243 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Request body: {'port': {'device_id': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'admin_state_up': True, 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:06.425917 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee33be06-cb17-4418-ac25-34d568aba10a req-617cee7c-43ac-44cb-a3d2-8ccec0721572 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.435762 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ee33be06-cb17-4418-ac25-34d568aba10a req-617cee7c-43ac-44cb-a3d2-8ccec0721572 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.3045468 Nov 18 21:01:06.445527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-a1c1c88e-3ce2-4876-94eb-7f7be83922af tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.448293 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-a1c1c88e-3ce2-4876-94eb-7f7be83922af tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 819 time: 0.3175833 Nov 18 21:01:06.520705 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a16a242-ca29-46cd-9849-9ea4a65ce189 req-5e4cdfc0-6bb4-4f0e-a187-8adb3ce27d62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.522274 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1a16a242-ca29-46cd-9849-9ea4a65ce189 req-5e4cdfc0-6bb4-4f0e-a187-8adb3ce27d62 service neutron] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.6765304 Nov 18 21:01:06.576307 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Request body: {'port': {'device_id': '3434e796-377f-4682-8853-5949c8a1e5f3', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'admin_state_up': True, 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:06.621848 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd481df3-f56b-4fbd-befa-5bf2abbebc18 req-35394ad1-c7b7-4267-a62d-377121eab73a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.624519 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fd481df3-f56b-4fbd-befa-5bf2abbebc18 req-35394ad1-c7b7-4267-a62d-377121eab73a service neutron] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5470703 Nov 18 21:01:06.653996 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ee33be06-cb17-4418-ac25-34d568aba10a req-3bfdbe73-9c0e-46f1-bc9d-a0bf7d815c1f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2166810 Nov 18 21:01:06.657709 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cf73d4fc-0231-4953-8f6d-72ac5f8cf17b req-124d48ca-f87e-42ad-9479-9362c5e658c1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.2054482 Nov 18 21:01:06.762488 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.62', 59556) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:06.869543 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-2d6c0568-2606-490c-bb72-1ce4513e035b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.869762 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.db.api [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 18 21:01:06.869762 dv-cinder-799871-8-iscsi neutron-server[102670]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 18 21:01:06.869762 dv-cinder-799871-8-iscsi neutron-server[102670]: [parameters: {'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'id': 'ae6ccb70-142f-4c9f-bd9e-31685d5b93f3', 'expiration': datetime.datetime(2021, 11, 18, 21, 3, 6, 858908)}] Nov 18 21:01:06.869762 dv-cinder-799871-8-iscsi neutron-server[102670]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=102670) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 18 21:01:06.870439 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG oslo_db.api [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 18 21:01:06.871116 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-2d6c0568-2606-490c-bb72-1ce4513e035b service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d84c0234ebde42a9a24ece0729b10890&device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 1097 time: 0.1885214 Nov 18 21:01:06.872577 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-5b4bcd5c-27b4-469c-b046-2fa9f7897427 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:06.875303 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-5b4bcd5c-27b4-469c-b046-2fa9f7897427 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 1096 time: 0.1452014 Nov 18 21:01:06.892947 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Made reservation on behalf of 5c11bd4ad5214d279c477c233d05b6d3 for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:06.897325 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:06.999697 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-895458b5-d0cb-4bbf-b459-90ffeaf153c3 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77 HTTP/1.1" status: 200 len: 217 time: 0.1065712 Nov 18 21:01:07.020370 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-5209398a-065c-4e31-b82e-9e73db1053be service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a HTTP/1.1" status: 200 len: 217 time: 0.1285503 Nov 18 21:01:07.167989 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-1ce1d97d-4417-4151-9515-0d385723b3c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:07.169697 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-1ce1d97d-4417-4151-9515-0d385723b3c0 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.1251738 Nov 18 21:01:07.235674 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a0741816-d54a-419e-b8e1-31ab0f2df6f1 req-8522cc3f-c230-48a7-8fd5-52d285a7ae67 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.1287069 Nov 18 21:01:07.271925 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-e0dff4dd-d9c2-4702-bc0d-b12247fe2729 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:07.278079 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-e0dff4dd-d9c2-4702-bc0d-b12247fe2729 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 816 time: 0.5036998 Nov 18 21:01:07.278493 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-28b31298-2794-499f-8a79-d112842a7b36 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0960419 Nov 18 21:01:07.324678 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-29a3dfdd-9ffa-4fb4-9bc2-d7713ed7b997 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:07.324678 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-29a3dfdd-9ffa-4fb4-9bc2-d7713ed7b997 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=39256260-0b56-47a0-a1ad-a05a1ac59638 HTTP/1.1" status: 200 len: 850 time: 0.2154007 Nov 18 21:01:07.438606 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-e8734dff-dc3a-4cc7-a74f-54c6a734c406 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=f1ea2660-7fe2-437d-9b30-7d386db79f6c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1092184 Nov 18 21:01:07.450455 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:07.497584 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f255082-e061-4e51-ba53-0cdb63b6dcfb req-43e503a8-3c03-4d69-906c-cfef9ca40718 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:07.497584 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4f255082-e061-4e51-ba53-0cdb63b6dcfb req-43e503a8-3c03-4d69-906c-cfef9ca40718 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.1740313 Nov 18 21:01:07.505257 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Made reservation on behalf of 5c11bd4ad5214d279c477c233d05b6d3 for: {'port': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:07.516318 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:07.533410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Allocated IP 172.20.0.11 (5973daa9-793c-40f5-972b-25507ee923a3/ecbb94e2-6852-471b-9339-07ed4834cbe7/618d8033-6b64-42ec-805f-1007401fc720) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:07.604843 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-01be3f0d-931e-4bfa-8295-878178758141 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3059108 Nov 18 21:01:07.646571 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-6abc2d1c-73c8-4d70-9031-e3ee8a11e740 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 380 time: 0.3293631 Nov 18 21:01:07.671138 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'port': {'device_id': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'admin_state_up': True, 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'security_groups': ['41378fa0-8beb-4fcf-8751-adebc0223629']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:07.676584 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4f255082-e061-4e51-ba53-0cdb63b6dcfb req-db523dd1-f75c-44b3-9170-e9b0b76d3328 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1722457 Nov 18 21:01:07.765807 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-573559e4-27d2-4c74-abc2-946ebb57ced6 service neutron] 10.222.0.62 "GET /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3170011 Nov 18 21:01:07.863709 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-984a97b9-4cf5-4925-8ee2-be33ae213329 req-293ee60f-790a-4f41-a10f-0efbccb7ad52 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.0693316 Nov 18 21:01:07.910630 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-6a2fb8fa-985e-4620-8be2-ae9d9cb11b28 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2484927 Nov 18 21:01:08.059099 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-2cbaaf31-9d99-4458-8c56-a17187b28ab1 service neutron] 10.222.0.62 "GET /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2603478 Nov 18 21:01:08.095101 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ca38881-9b24-4749-8294-f7cbbce22645 req-aad78d16-5e1e-44cc-9608-9e1ea5ffcdbc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:08.097072 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1ca38881-9b24-4749-8294-f7cbbce22645 req-aad78d16-5e1e-44cc-9608-9e1ea5ffcdbc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.1520634 Nov 18 21:01:08.113902 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Made reservation on behalf of d6128eda2acb42f3b896c4d4a809ed0e for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:08.117451 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:08.137708 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:08.248994 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:08.266105 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1ca38881-9b24-4749-8294-f7cbbce22645 req-701cac71-aa94-4034-80f5-b45cd4386460 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1593041 Nov 18 21:01:08.287982 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:08.419754 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Network 5973daa9-793c-40f5-972b-25507ee923a3 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:08.433151 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:08.438919 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Pushing event updated for resources: {'Port': ['ID=618d8033-6b64-42ec-805f-1007401fc720,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:08.441621 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:08.448389 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:08.449063 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:08.461146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Allocated IP 172.20.0.10 (c212623b-e2b5-4f51-9cd5-a24f8a69f653/bc253697-be56-4044-aeb5-455225f5b7ab/36578666-b0b7-4111-a019-33bc4c0ac780) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:08.480638 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-fa4bd7b1-3e8f-4728-9926-936f21d1cf2c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.1172740 Nov 18 21:01:08.504088 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Request body: {'port': {'device_id': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:08.588410 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6849eff2-0db1-429f-84b6-5d58c0d83c45 req-8f61641a-21e5-47a0-82f7-7886dc245263 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.0523438 Nov 18 21:01:08.643587 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Allocated IP 172.20.0.14 (5973daa9-793c-40f5-972b-25507ee923a3/ecbb94e2-6852-471b-9339-07ed4834cbe7/972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:08.984379 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.044456 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.092531 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e0857463-f6a5-484e-90f3-639209e63c5b req-8a1f25a5-b982-4595-9b9a-9381db61f82e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:09.095007 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e0857463-f6a5-484e-90f3-639209e63c5b req-8a1f25a5-b982-4595-9b9a-9381db61f82e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.2447264 Nov 18 21:01:09.142780 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.155782 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-520a9148-33b0-436d-a33b-afcb4386f68c req-a20f60ba-1aa7-40bb-a075-24cb7bdc4db0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.1161423 Nov 18 21:01:09.246214 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33134) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:09.293349 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.422727 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Network 5973daa9-793c-40f5-972b-25507ee923a3 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:09.462942 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:09.463983 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e0857463-f6a5-484e-90f3-639209e63c5b req-996c086b-38b9-4233-b2a8-f1c86f6289f2 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3499036 Nov 18 21:01:09.494324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:09.499108 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.505832 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:09.506503 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.510218 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Pushing event updated for resources: {'Port': ['ID=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:09.610399 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:09.622135 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:09.624308 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:09.629008 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:09.636486 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:09.637497 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.640040 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-478f2d65-9fe0-43e1-be48-8d10e0c533fc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.1166036 Nov 18 21:01:09.645947 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-36a6d000-8fc1-490d-b46c-51a9e6bda0a8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.669239 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Request body: {'port': {'device_id': '3434e796-377f-4682-8853-5949c8a1e5f3', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:09.705746 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-3e2f2424-35d7-461e-b49d-34ad099d0a57 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0433924 Nov 18 21:01:09.724042 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Request body: {'port': {'device_id': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:09.759796 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 618d8033-6b64-42ec-805f-1007401fc720 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:09.761678 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33148) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:09.781375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.835840 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a0233b7-4d75-4345-aeba-4b542e16d57f req-ba0732da-9392-4947-af88-d13b358ec3dd tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:09.838116 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a0233b7-4d75-4345-aeba-4b542e16d57f req-ba0732da-9392-4947-af88-d13b358ec3dd tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.3192821 Nov 18 21:01:09.842163 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Transition to ACTIVE for port object 618d8033-6b64-42ec-805f-1007401fc720 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:01:09.843855 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.859812 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.888185 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb6705ce-7f53-4bca-8563-d43623853963 req-6bf770b2-928c-48c6-853e-b618f59eee15 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:09.890554 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bb6705ce-7f53-4bca-8563-d43623853963 req-6bf770b2-928c-48c6-853e-b618f59eee15 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 932 time: 0.1397662 Nov 18 21:01:09.919906 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.928939 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-36a6d000-8fc1-490d-b46c-51a9e6bda0a8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.949123 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-36a6d000-8fc1-490d-b46c-51a9e6bda0a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.993397 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15c4d457-f9fd-4664-9658-a674fc5973ca admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:09.998383 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-cfa75a89-bb76-4c82-ad14-9a3328553176 None None] Provisioning complete for port 36578666-b0b7-4111-a019-33bc4c0ac780 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:09.999397 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cfa75a89-bb76-4c82-ad14-9a3328553176 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.037387 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-cfa75a89-bb76-4c82-ad14-9a3328553176 None None] Port 36578666-b0b7-4111-a019-33bc4c0ac780 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:01:10.043440 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a0233b7-4d75-4345-aeba-4b542e16d57f req-1c59045b-1ce9-49aa-b2a3-c8efefdf47f5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1954470 Nov 18 21:01:10.049047 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Pushing event updated for resources: {'Port': ['ID=618d8033-6b64-42ec-805f-1007401fc720,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.100935 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36a6d000-8fc1-490d-b46c-51a9e6bda0a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d9d6db6f-9231-4773-bb93-4a0a076f03e1,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.121932 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-36a6d000-8fc1-490d-b46c-51a9e6bda0a8 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d35d55584a444dffbff8517cfaa471e4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8670013 Nov 18 21:01:10.125324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33152) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:10.142038 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Attempting to bind port 618d8033-6b64-42ec-805f-1007401fc720 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:01:10.142304 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Attempting to bind port 618d8033-6b64-42ec-805f-1007401fc720 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:01:10.142592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Attempting to bind port 618d8033-6b64-42ec-805f-1007401fc720 on network 5973daa9-793c-40f5-972b-25507ee923a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:10.163826 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bb6705ce-7f53-4bca-8563-d43623853963 req-8f184536-c487-470f-a9b1-14af49cceb75 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2223060 Nov 18 21:01:10.219618 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Port 618d8033-6b64-42ec-805f-1007401fc720 on network 5973daa9-793c-40f5-972b-25507ee923a3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:01:10.219935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Attempting to bind port 618d8033-6b64-42ec-805f-1007401fc720 on network 5973daa9-793c-40f5-972b-25507ee923a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:10.230981 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:01:10.231315 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Checking segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:10.231699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Bound using segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:01:10.232186 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Bound port: 618d8033-6b64-42ec-805f-1007401fc720, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:01:10.232546 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.318975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-28660795-09be-493a-83c3-f767c9d8946d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.364304 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15c4d457-f9fd-4664-9658-a674fc5973ca admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.370299 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] For port 618d8033-6b64-42ec-805f-1007401fc720, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:01:10.378683 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] For port 618d8033-6b64-42ec-805f-1007401fc720, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=618d8033-6b64-42ec-805f-1007401fc720,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:01:10.383548 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-28660795-09be-493a-83c3-f767c9d8946d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.385727 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-15c4d457-f9fd-4664-9658-a674fc5973ca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.389272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.450056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:10.450801 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.452586 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] 10.222.0.62 "PUT /v2.0/ports/618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 1094 time: 1.9550619 Nov 18 21:01:10.454978 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'tag': '618d8033-6b64-42ec-805f-1007401fc720'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:10.457709 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c799bc58-5420-4e25-837a-a7c266bd37e1" -d '{"events": [{"name": "network-changed", "server_uuid": "6956f4de-9dd5-4438-a7d9-fb2e1b228343", "tag": "618d8033-6b64-42ec-805f-1007401fc720"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:10.459518 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eda4d14a-3f92-4415-a1f5-7a7108ca8ba1 req-2220d1f9-bf0f-45ae-b222-3643f0259ce6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:10.461576 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eda4d14a-3f92-4415-a1f5-7a7108ca8ba1 req-2220d1f9-bf0f-45ae-b222-3643f0259ce6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 932 time: 0.1984458 Nov 18 21:01:10.496937 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-15c4d457-f9fd-4664-9658-a674fc5973ca admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3082dcff2fbb42629b4d129c584c31b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7293315 Nov 18 21:01:10.503279 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 33166) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:10.518449 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15c4d457-f9fd-4664-9658-a674fc5973ca admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=223afe21-1494-4db3-8546-dda2ea374300,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.536652 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78b9cd76-7eb5-42f3-92b0-c84c3785f450 service neutron] Pushing event updated for resources: {'Port': ['ID=618d8033-6b64-42ec-805f-1007401fc720,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.579598 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 36578666-b0b7-4111-a019-33bc4c0ac780 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:10.593745 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d {{(pid=102670) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:10.607525 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.607761 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.619254 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-28660795-09be-493a-83c3-f767c9d8946d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.621909 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-28660795-09be-493a-83c3-f767c9d8946d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.623060 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-28660795-09be-493a-83c3-f767c9d8946d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d9d6db6f-9231-4773-bb93-4a0a076f03e1 HTTP/1.1" status: 204 len: 168 time: 0.4959598 Nov 18 21:01:10.648387 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Transition to ACTIVE for port object 36578666-b0b7-4111-a019-33bc4c0ac780 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:01:10.650468 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-702fade5-bbfb-495a-b622-3a3a5f8b5cf7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.660995 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.673394 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eda4d14a-3f92-4415-a1f5-7a7108ca8ba1 req-52c0abf3-f168-453f-b4ec-5c8d8a324070 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1680832 Nov 18 21:01:10.677315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28660795-09be-493a-83c3-f767c9d8946d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d9d6db6f-9231-4773-bb93-4a0a076f03e1,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.692830 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.provisioning_blocks [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Transition to ACTIVE for port object 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d will not be triggered until provisioned by entity L2. {{(pid=102670) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:01:10.703351 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.709007 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-07fe8d66-1c8d-456d-98bd-89a301f5ba3b x-openstack-request-id: req-07fe8d66-1c8d-456d-98bd-89a301f5ba3b {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:10.709289 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6956f4de-9dd5-4438-a7d9-fb2e1b228343", "tag": "618d8033-6b64-42ec-805f-1007401fc720", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:10.709698 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-07fe8d66-1c8d-456d-98bd-89a301f5ba3b {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:10.710353 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'tag': '618d8033-6b64-42ec-805f-1007401fc720', 'status': 'completed', 'code': 200} Nov 18 21:01:10.721566 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-702fade5-bbfb-495a-b622-3a3a5f8b5cf7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.776509 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.861302 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Attempting to bind port 36578666-b0b7-4111-a019-33bc4c0ac780 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:01:10.861673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Attempting to bind port 36578666-b0b7-4111-a019-33bc4c0ac780 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:01:10.862019 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Attempting to bind port 36578666-b0b7-4111-a019-33bc4c0ac780 on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:10.877934 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Port 36578666-b0b7-4111-a019-33bc4c0ac780 on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:01:10.879145 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Pushing event updated for resources: {'Port': ['ID=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:10.879689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Attempting to bind port 36578666-b0b7-4111-a019-33bc4c0ac780 on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:10.890172 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:01:10.890535 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Checking segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:10.890890 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Bound using segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:01:10.891329 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Bound port: 36578666-b0b7-4111-a019-33bc4c0ac780, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:01:10.891785 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:10.934054 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Attempting to bind port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:01:10.934445 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Attempting to bind port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:01:10.934865 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Attempting to bind port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d on network 5973daa9-793c-40f5-972b-25507ee923a3 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:10.942325 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d on network 5973daa9-793c-40f5-972b-25507ee923a3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:01:10.942753 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Attempting to bind port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d on network 5973daa9-793c-40f5-972b-25507ee923a3 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:10.955619 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 0, 50), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:01:10.956238 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Checking segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:10.956435 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Bound using segment: {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:01:10.956872 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Bound port: 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '346175a8-8f3b-4db0-acce-2b22e5308fa2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 640, 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3'}}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:01:10.957246 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.010105 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-702fade5-bbfb-495a-b622-3a3a5f8b5cf7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.014667 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-702fade5-bbfb-495a-b622-3a3a5f8b5cf7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.016376 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-702fade5-bbfb-495a-b622-3a3a5f8b5cf7 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/223afe21-1494-4db3-8546-dda2ea374300 HTTP/1.1" status: 204 len: 168 time: 0.5119698 Nov 18 21:01:11.061862 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b85fdb94-8cc8-44f5-a898-84c931eb12e9 req-6094f24b-66c7-4513-9129-1ab5d178359a tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:11.063945 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b85fdb94-8cc8-44f5-a898-84c931eb12e9 req-6094f24b-66c7-4513-9129-1ab5d178359a tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.1880460 Nov 18 21:01:11.067058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-702fade5-bbfb-495a-b622-3a3a5f8b5cf7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=223afe21-1494-4db3-8546-dda2ea374300,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:11.109324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] For port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host hv-cinder-79987, cleared binding levels {{(pid=102670) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:01:11.119277 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] For port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102670) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:01:11.131275 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.138959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:01:11.148742 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:11.150256 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.151665 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] 10.222.0.62 "PUT /v2.0/ports/972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d HTTP/1.1" status: 200 len: 1094 time: 1.4920995 Nov 18 21:01:11.153597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '3434e796-377f-4682-8853-5949c8a1e5f3', 'tag': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:11.156444 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7" -d '{"events": [{"name": "network-changed", "server_uuid": "3434e796-377f-4682-8853-5949c8a1e5f3", "tag": "972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:11.239307 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b85fdb94-8cc8-44f5-a898-84c931eb12e9 req-eb6847d2-a235-4386-a2a8-a8e37e9f210f tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1647029 Nov 18 21:01:11.244986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:01:11.246009 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 33198) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:11.267054 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.322605 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c2fa57-18ea-428b-b5d8-85c8f3dceaec req-f97d59cb-1153-4fe0-99d7-2b9dd21d4b20 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:11.330267 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-69ba7d53-3154-480b-b502-33c54ce33c27 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.332133 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-13c2fa57-18ea-428b-b5d8-85c8f3dceaec req-f97d59cb-1153-4fe0-99d7-2b9dd21d4b20 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.1397383 Nov 18 21:01:11.344012 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f9fa8a10-04ae-4cb6-94a9-0d065c8a22e3 x-openstack-request-id: req-f9fa8a10-04ae-4cb6-94a9-0d065c8a22e3 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:11.344564 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "3434e796-377f-4682-8853-5949c8a1e5f3", "tag": "972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:11.345198 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f9fa8a10-04ae-4cb6-94a9-0d065c8a22e3 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:11.345945 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '3434e796-377f-4682-8853-5949c8a1e5f3', 'tag': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d', 'status': 'completed', 'code': 200} Nov 18 21:01:11.347963 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-822a12ff-9f48-4148-bc03-c74e32c3a7bd service neutron] Pushing event updated for resources: {'Port': ['ID=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,revision_number=3']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:11.412631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:11.412631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.412631 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] 10.222.0.62 "PUT /v2.0/ports/36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 200 len: 1094 time: 1.6903191 Nov 18 21:01:11.425268 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ac231fb-07b9-44ac-8d3b-34d6883c2d34 service neutron] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:11.426498 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-13c2fa57-18ea-428b-b5d8-85c8f3dceaec req-d6af22da-4ce9-45d3-88ec-f43239ce978c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932031 Nov 18 21:01:11.535226 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18e1a1ae-a7cc-4b57-89fa-f201ccef0182 req-afc79dbc-5e77-4457-89bf-8e938954e84a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:11.543223 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18e1a1ae-a7cc-4b57-89fa-f201ccef0182 req-afc79dbc-5e77-4457-89bf-8e938954e84a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0986567 Nov 18 21:01:11.592937 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-69ba7d53-3154-480b-b502-33c54ce33c27 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.605883 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-69ba7d53-3154-480b-b502-33c54ce33c27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.634460 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18e1a1ae-a7cc-4b57-89fa-f201ccef0182 req-8871ef57-5bab-4c1d-8ab0-1b1a2f347ed6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0900161 Nov 18 21:01:11.659665 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-69ba7d53-3154-480b-b502-33c54ce33c27 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=53d0c3cc11854981a8ea9ed63a4b9754&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4111657 Nov 18 21:01:11.662238 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33208) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:11.669118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-69ba7d53-3154-480b-b502-33c54ce33c27 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4669a6b7-3d95-4166-82a1-6242eda7c921,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:11.731329 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-58d8f211-6576-4e37-8c80-8d26231ea366 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.765095 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-58d8f211-6576-4e37-8c80-8d26231ea366 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.835021 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d257991e-3c1f-489c-b5c1-3e7528241feb req-3b1a9d33-8d7b-48c0-8621-cb7f658e1113 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:11.837600 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d257991e-3c1f-489c-b5c1-3e7528241feb req-3b1a9d33-8d7b-48c0-8621-cb7f658e1113 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.0867991 Nov 18 21:01:11.875644 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-58d8f211-6576-4e37-8c80-8d26231ea366 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.878239 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-58d8f211-6576-4e37-8c80-8d26231ea366 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:11.879390 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-58d8f211-6576-4e37-8c80-8d26231ea366 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/4669a6b7-3d95-4166-82a1-6242eda7c921 HTTP/1.1" status: 204 len: 168 time: 0.2156630 Nov 18 21:01:11.902310 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58d8f211-6576-4e37-8c80-8d26231ea366 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4669a6b7-3d95-4166-82a1-6242eda7c921,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:11.909012 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d257991e-3c1f-489c-b5c1-3e7528241feb req-6f3f07f0-285a-4e38-b9fc-a6e2e2f293d8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0652814 Nov 18 21:01:12.375263 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-35ea4ae5-47a0-469e-8157-b19846fb8d95 req-808bb8e7-d8ee-4f2b-a535-c7311881c80c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:12.379593 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-35ea4ae5-47a0-469e-8157-b19846fb8d95 req-808bb8e7-d8ee-4f2b-a535-c7311881c80c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.0574381 Nov 18 21:01:12.434438 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-35ea4ae5-47a0-469e-8157-b19846fb8d95 req-caf048ab-c714-446c-91b5-a04ff1d3b43a tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512848 Nov 18 21:01:12.559563 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd41f8d5-84f2-44fb-ba2c-9a394e963e2b req-7a0972b8-4b9f-47f4-9e6b-b72e752f95a0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:12.561485 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd41f8d5-84f2-44fb-ba2c-9a394e963e2b req-7a0972b8-4b9f-47f4-9e6b-b72e752f95a0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 943 time: 0.0587285 Nov 18 21:01:12.614590 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd41f8d5-84f2-44fb-ba2c-9a394e963e2b req-0be86459-bdf2-4a83-9d6a-c7772446941c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463507 Nov 18 21:01:12.660757 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33268) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:12.706000 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33274) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:12.712074 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:12.714869 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-07f5cd57-8e39-4b5d-9237-f56543d4d646" -d '{"events": [{"name": "network-changed", "server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:12.769142 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1fa4cbce-faa8-490b-9da7-914cce40aaa4 x-openstack-request-id: req-1fa4cbce-faa8-490b-9da7-914cce40aaa4 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:12.769518 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:12.769870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-1fa4cbce-faa8-490b-9da7-914cce40aaa4 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:12.770343 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'status': 'completed', 'code': 200} Nov 18 21:01:12.789147 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f6368e0-e57f-406c-b4f9-db7c17da448d req-d697dcba-10cd-4c5a-aa09-f41ad1cf6e2b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:12.791191 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5f6368e0-e57f-406c-b4f9-db7c17da448d req-d697dcba-10cd-4c5a-aa09-f41ad1cf6e2b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0614107 Nov 18 21:01:12.838009 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1673653654-network', 'tenant_id': 'd9611baddf3943198c1937bb0b65f000'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:12.849524 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a676513e-b5ed-4196-9f1f-2a2544bd6310 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:12.851054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5f6368e0-e57f-406c-b4f9-db7c17da448d req-dc91b162-e56a-4af0-970b-ecaf03861f08 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0538318 Nov 18 21:01:12.884795 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Made reservation on behalf of d9611baddf3943198c1937bb0b65f000 for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:12.886974 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:12.909489 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:12.965020 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 67b470ac-d502-4785-a1b3-cabbdf1eaf77 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:01:13.094130 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c799bc58-5420-4e25-837a-a7c266bd37e1 req-b42c752f-ca6b-4021-87e1-f82ca1310e29 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.097886 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c799bc58-5420-4e25-837a-a7c266bd37e1 req-b42c752f-ca6b-4021-87e1-f82ca1310e29 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1097 time: 0.1219368 Nov 18 21:01:13.110576 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7 req-bab2c547-97da-4411-aaad-b99056789d47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.112583 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7 req-bab2c547-97da-4411-aaad-b99056789d47 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 1097 time: 0.0747101 Nov 18 21:01:13.129426 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a676513e-b5ed-4196-9f1f-2a2544bd6310 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.130374 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:13.148426 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a676513e-b5ed-4196-9f1f-2a2544bd6310 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.149604 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '67b470ac-d502-4785-a1b3-cabbdf1eaf77', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'port_id': '67b470ac-d502-4785-a1b3-cabbdf1eaf77', 'mac_address': 'fa:16:3e:2f:4f:83', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 604, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fcebaf13-b181-404f-a8e5-52ddbe0c8c7c', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:01:13.161116 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f5cd57-8e39-4b5d-9237-f56543d4d646 req-517c780e-4140-4722-abfd-bac1f3e15e4e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.162765 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-07f5cd57-8e39-4b5d-9237-f56543d4d646 req-517c780e-4140-4722-abfd-bac1f3e15e4e service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1097 time: 0.1632166 Nov 18 21:01:13.218651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.247453 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 67b470ac-d502-4785-a1b3-cabbdf1eaf77 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:13.279754 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:13.291434 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.292643 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3d1065d4-abc3-48ca-9275-5c415cb3466a details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:01:13.298828 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a676513e-b5ed-4196-9f1f-2a2544bd6310 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cc3b263-afc3-477a-a1e6-a339d78bc079,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:13.303037 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.313249 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a676513e-b5ed-4196-9f1f-2a2544bd6310 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a707fabc4f464629b7f0f8006d83a857&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6060965 Nov 18 21:01:13.316969 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33284) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:13.327030 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32a02420-05fd-4adf-8853-751819ab8da4 req-f02cb1bb-f1b0-4227-9cd8-a4f920c72b58 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.330420 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-32a02420-05fd-4adf-8853-751819ab8da4 req-f02cb1bb-f1b0-4227-9cd8-a4f920c72b58 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.2815902 Nov 18 21:01:13.342481 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.364334 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7 req-ce13fda7-4e5a-43f4-afb7-933136381faf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.372668 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7 req-ce13fda7-4e5a-43f4-afb7-933136381faf service neutron] 10.222.0.62 "GET /v2.0/networks?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2434788 Nov 18 21:01:13.373959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c799bc58-5420-4e25-837a-a7c266bd37e1 req-ae1dbcee-18d4-4975-b7fa-d88228f7ee72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.376322 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c799bc58-5420-4e25-837a-a7c266bd37e1 req-ae1dbcee-18d4-4975-b7fa-d88228f7ee72 service neutron] 10.222.0.62 "GET /v2.0/networks?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&shared=False HTTP/1.1" status: 200 len: 920 time: 0.2623641 Nov 18 21:01:13.429755 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 629} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:01:13.443047 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=67b470ac-d502-4785-a1b3-cabbdf1eaf77,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:13.469694 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4fcb1a46-94f6-4589-9cb0-64ceca8e5cc3,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:13.482155 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.482480 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Added segment 2b67f587-ae65-48d1-8eda-f85b04a9a47a of type vlan for network 7acc544e-e22e-4612-9a9e-a730bb0c4847 Nov 18 21:01:13.501017 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f5cd57-8e39-4b5d-9237-f56543d4d646 req-59a69b0f-8199-49bb-b94c-468562007bff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.502372 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-07f5cd57-8e39-4b5d-9237-f56543d4d646 req-59a69b0f-8199-49bb-b94c-468562007bff service neutron] 10.222.0.62 "GET /v2.0/networks?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&shared=False HTTP/1.1" status: 200 len: 917 time: 0.3182831 Nov 18 21:01:13.533612 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3d1065d4-abc3-48ca-9275-5c415cb3466a, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a,segment=NetworkSegment(1822c8a3-e235-4644-8a58-074d8932baed),segment_id=1822c8a3-e235-4644-8a58-074d8932baed)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:13.559932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '3d1065d4-abc3-48ca-9275-5c415cb3466a', 'network_id': 'f1ea2660-7fe2-437d-9b30-7d386db79f6c', 'port_id': '3d1065d4-abc3-48ca-9275-5c415cb3466a', 'mac_address': 'fa:16:3e:dc:2a:a6', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 622, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '39256260-0b56-47a0-a1ad-a05a1ac59638', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:01:13.566406 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-32a02420-05fd-4adf-8853-751819ab8da4 req-78be9547-8f61-4f13-8c01-5e73ba891d7c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2264180 Nov 18 21:01:13.573600 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7 req-013e19f9-1da7-4f46-97f2-9ca584387d57 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.578184 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c86cde7-5d75-45bf-b861-cd2d99fea6f7 req-013e19f9-1da7-4f46-97f2-9ca584387d57 service neutron] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1888881 Nov 18 21:01:13.579500 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c799bc58-5420-4e25-837a-a7c266bd37e1 req-9016ff75-ffd0-4d3b-b314-21aa406c6196 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.580893 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c799bc58-5420-4e25-837a-a7c266bd37e1 req-9016ff75-ffd0-4d3b-b314-21aa406c6196 service neutron] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1828480 Nov 18 21:01:13.643061 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.646123 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5156927c-0b5d-4c89-a291-7af59ce597ed admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.655980 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.687501 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3d1065d4-abc3-48ca-9275-5c415cb3466a {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:13.730714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3d1065d4-abc3-48ca-9275-5c415cb3466a, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a,segment=NetworkSegment(1822c8a3-e235-4644-8a58-074d8932baed),segment_id=1822c8a3-e235-4644-8a58-074d8932baed)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:13.737844 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.745750 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2307dacc-8270-4f15-b861-8fb23975d255 req-9d66e788-34fc-4764-927e-531a2a769325 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.747747 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2307dacc-8270-4f15-b861-8fb23975d255 req-9d66e788-34fc-4764-927e-531a2a769325 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 944 time: 0.1325560 Nov 18 21:01:13.783189 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5156927c-0b5d-4c89-a291-7af59ce597ed admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.786471 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-c8619bbc-7c8e-4ef5-bef9-c09d165c4c06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.788022 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-c8619bbc-7c8e-4ef5-bef9-c09d165c4c06 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 1097 time: 0.1280811 Nov 18 21:01:13.791637 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-d1306b13-78b8-450f-a51a-24025f8a55fd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.793444 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-d1306b13-78b8-450f-a51a-24025f8a55fd service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1097 time: 0.1345971 Nov 18 21:01:13.813562 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.814958 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:13.815539 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:13.835606 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3d1065d4-abc3-48ca-9275-5c415cb3466a,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:13.918731 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-691d2d64-d68d-49a8-8d45-7548ff35683c service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 217 time: 0.0984709 Nov 18 21:01:13.922628 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2307dacc-8270-4f15-b861-8fb23975d255 req-ff4968e2-9299-4774-a0db-df52a231a3db tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1615262 Nov 18 21:01:13.924043 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-dc4fa1a8-c542-4c9b-874d-5c91c637242b service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d HTTP/1.1" status: 200 len: 217 time: 0.1053171 Nov 18 21:01:14.052397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-55accc63-fb32-4eb1-b56e-196181176331 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.056790 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-55accc63-fb32-4eb1-b56e-196181176331 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.1200442 Nov 18 21:01:14.105043 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-57963911-48be-4e0e-b35e-74af699394cf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.107342 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-57963911-48be-4e0e-b35e-74af699394cf service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.1636760 Nov 18 21:01:14.114937 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07f5cd57-8e39-4b5d-9237-f56543d4d646 req-94730b02-9d43-4b8e-8777-9788dc2960c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.116478 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-07f5cd57-8e39-4b5d-9237-f56543d4d646 req-94730b02-9d43-4b8e-8777-9788dc2960c2 service neutron] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.5847361 Nov 18 21:01:14.116674 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-1a717a6d-6546-4521-872b-2c7888f6d0fa service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0441408 Nov 18 21:01:14.119592 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] Pushing event updated for resources: {'Network': ['ID=7acc544e-e22e-4612-9a9e-a730bb0c4847,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:14.127011 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-05f752fe-7d5e-49bc-926d-7b18a09b2d04 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.4624493 Nov 18 21:01:14.128199 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33306) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:14.137422 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aeccc92-5b65-4904-92a9-3fe513f72045 req-8234d8df-5b71-4aa9-9d53-b93ba8abbcab tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.140019 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['3d1065d4-abc3-48ca-9275-5c415cb3466a'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:01:14.144594 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4aeccc92-5b65-4904-92a9-3fe513f72045 req-8234d8df-5b71-4aa9-9d53-b93ba8abbcab tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 944 time: 0.4181156 Nov 18 21:01:14.150100 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-6e0de9cb-56ef-4066-8ada-066f565e419f service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0304136 Nov 18 21:01:14.150680 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Request body: {'subnet': {'network_id': '7acc544e-e22e-4612-9a9e-a730bb0c4847', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1673653654-subnet', 'tenant_id': 'd9611baddf3943198c1937bb0b65f000', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:14.189729 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5156927c-0b5d-4c89-a291-7af59ce597ed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:14.192250 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5156927c-0b5d-4c89-a291-7af59ce597ed admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:14.193401 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-5156927c-0b5d-4c89-a291-7af59ce597ed admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1cc3b263-afc3-477a-a1e6-a339d78bc079 HTTP/1.1" status: 204 len: 168 time: 0.8641782 Nov 18 21:01:14.220709 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Made reservation on behalf of d9611baddf3943198c1937bb0b65f000 for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:14.223108 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Publish callbacks [] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:14.235150 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5156927c-0b5d-4c89-a291-7af59ce597ed admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cc3b263-afc3-477a-a1e6-a339d78bc079,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:14.250548 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:01:14.268621 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 7acc544e-e22e-4612-9a9e-a730bb0c4847 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:01:14.299784 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4aeccc92-5b65-4904-92a9-3fe513f72045 req-7a95da84-1efa-4051-abd7-a04a0514fc1f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1541171 Nov 18 21:01:14.342118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f180239-9b75-4890-b85b-1a573b95c48c req-9b832543-b4f1-4da9-bcc0-df8b599c9776 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.350417 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0f180239-9b75-4890-b85b-1a573b95c48c req-9b832543-b4f1-4da9-bcc0-df8b599c9776 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.3232448 Nov 18 21:01:14.364410 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-615768e7-5327-423d-85d8-d1bc1db623fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.365910 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-615768e7-5327-423d-85d8-d1bc1db623fb service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1097 time: 0.1607716 Nov 18 21:01:14.442773 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-25b0662e-b2ee-4a90-8d07-de5609837d48 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 200 len: 217 time: 0.0657620 Nov 18 21:01:14.552213 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-e35b2b02-f95d-46b9-97ca-6587c10aeaac service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.553861 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-e35b2b02-f95d-46b9-97ca-6587c10aeaac service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0674627 Nov 18 21:01:14.780784 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:14.806570 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0f180239-9b75-4890-b85b-1a573b95c48c req-1f21cc72-62da-4b20-aef3-0130d16c6ba0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4499099 Nov 18 21:01:14.813025 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-cfc0f825-9f9d-4890-bf3e-0f3698dca7ad service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6547523 Nov 18 21:01:14.817646 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-0456c288-0206-4199-961e-b53552c21365 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6675870 Nov 18 21:01:14.876809 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-5f1343c5-e15f-40d9-901b-30ac01338742 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.878320 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-5f1343c5-e15f-40d9-901b-30ac01338742 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2500641 Nov 18 21:01:14.905693 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b41069-b67c-4236-9619-4e0f9eea09ed req-44407746-7b6c-44ab-a525-0091ec044169 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:14.907459 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7b41069-b67c-4236-9619-4e0f9eea09ed req-44407746-7b6c-44ab-a525-0091ec044169 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.1888855 Nov 18 21:01:14.919417 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Pushing event updated for resources: {'Subnet': ['ID=98cabe4f-101c-4479-9ab8-6bb088ca3426,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:15.009101 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Checking segment: {'id': '2b67f587-ae65-48d1-8eda-f85b04a9a47a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 629, 'network_id': '7acc544e-e22e-4612-9a9e-a730bb0c4847'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:15.009507 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Network hostable DHCP agents. Network: 7acc544e-e22e-4612-9a9e-a730bb0c4847, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:01:15.104870 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7b41069-b67c-4236-9619-4e0f9eea09ed req-76e92cdb-22ea-45d7-81b4-c49a32bc4c88 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1797142 Nov 18 21:01:15.104870 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Network 7acc544e-e22e-4612-9a9e-a730bb0c4847 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:01:15.114587 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-37b3f11d-a041-4458-b0e5-772f0bf3816a service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2236733 Nov 18 21:01:15.115645 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 7acc544e-e22e-4612-9a9e-a730bb0c4847) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:15.129517 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:15.130113 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:15.149023 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0abe331a-0615-4701-a35e-78d969b74cfd None None] Network 7acc544e-e22e-4612-9a9e-a730bb0c4847 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:01:15.161054 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ca817444-4dbf-4a73-892c-ed2b52b54fca admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.0327013 Nov 18 21:01:15.175200 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e9f9918d-6789-44a6-924d-8de7ab5d88f5 req-516dac7e-ad77-4ccd-be86-b7602e4f2bd0 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3396573 Nov 18 21:01:15.177890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19ce18a9-37b9-4a37-8bdf-cc90cf0d0c36 req-c316d6eb-f882-4ed4-bb97-00a1fd313a90 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3423877 Nov 18 21:01:15.211415 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9642eeb7-1b41-4737-adb4-5ed34da9a7b1 req-dda13dd9-91ff-4f98-a9bd-6ce1e139a0c2 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:15.215477 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9642eeb7-1b41-4737-adb4-5ed34da9a7b1 req-dda13dd9-91ff-4f98-a9bd-6ce1e139a0c2 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 945 time: 0.1767364 Nov 18 21:01:15.274344 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9642eeb7-1b41-4737-adb4-5ed34da9a7b1 req-cadbf400-3596-4546-b70d-58abd0473d37 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0530229 Nov 18 21:01:15.434156 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f06233a5-0358-41fa-82bb-3607b49d5f72 None None] Network 7acc544e-e22e-4612-9a9e-a730bb0c4847 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:01:15.485968 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77e9e44a-c685-49db-b012-4f7c68ffa58c req-5a23ff9e-44e5-481a-99b2-d99cffe56e05 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:15.487704 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-77e9e44a-c685-49db-b012-4f7c68ffa58c req-5a23ff9e-44e5-481a-99b2-d99cffe56e05 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 944 time: 0.1078420 Nov 18 21:01:15.558217 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-77e9e44a-c685-49db-b012-4f7c68ffa58c req-4e378d9b-5261-4c90-9f01-467db7b55f2c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625165 Nov 18 21:01:15.941004 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad48c88-d270-4f9e-8cfd-e51aae1140eb req-61d27868-0bf3-483e-b1a4-413fc1530f6f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:15.942681 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9ad48c88-d270-4f9e-8cfd-e51aae1140eb req-61d27868-0bf3-483e-b1a4-413fc1530f6f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0626998 Nov 18 21:01:15.997875 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9ad48c88-d270-4f9e-8cfd-e51aae1140eb req-8ce1f56c-c47c-4d77-81f0-d9f1b480bf79 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0467551 Nov 18 21:01:16.108212 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33402) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:16.113029 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1710115586-network', 'tenant_id': 'd41878b5642f44c8a28b650414407a81'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:16.136085 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Made reservation on behalf of d41878b5642f44c8a28b650414407a81 for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:16.138492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.147621 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.257336 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82c12b46-5f5b-4f9e-9796-89d644ef5bf1 req-b7313aed-c178-4764-bf9f-d37a7ceace97 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:16.258787 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-82c12b46-5f5b-4f9e-9796-89d644ef5bf1 req-b7313aed-c178-4764-bf9f-d37a7ceace97 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.0778883 Nov 18 21:01:16.290108 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.295445 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.340400 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:01:16.363179 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-82c12b46-5f5b-4f9e-9796-89d644ef5bf1 req-cba85535-4273-4529-a8c7-815511bfd511 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0983257 Nov 18 21:01:16.370340 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8df947f7-1f54-4ab4-ac88-f268b4ccc0f6,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:16.374743 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.375093 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Added segment 9bdbd408-d7a8-4c1f-a2a2-775ff23bede4 of type vlan for network a243042a-74f9-4ab9-8244-32fa08c301a4 Nov 18 21:01:16.401644 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1137790-febd-4906-8a1d-abf1f0407972 req-d1286c06-1d63-465f-a576-f75b0db2a1b9 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:16.403337 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c1137790-febd-4906-8a1d-abf1f0407972 req-d1286c06-1d63-465f-a576-f75b0db2a1b9 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 945 time: 0.0554590 Nov 18 21:01:16.433552 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.462195 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.464939 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:16.465928 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.468715 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c1137790-febd-4906-8a1d-abf1f0407972 req-39fa81d3-9850-4081-8c2d-e11e376514c7 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0584607 Nov 18 21:01:16.532312 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 0.4229481 Nov 18 21:01:16.534959 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33410) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:16.541900 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Request body: {'subnet': {'network_id': 'a243042a-74f9-4ab9-8244-32fa08c301a4', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1710115586-subnet', 'tenant_id': 'd41878b5642f44c8a28b650414407a81', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:16.550532 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1118757e-a9cc-4ba7-bc87-b545c7585969 admin admin] Pushing event updated for resources: {'Network': ['ID=a243042a-74f9-4ab9-8244-32fa08c301a4,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:16.565608 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network a243042a-74f9-4ab9-8244-32fa08c301a4 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:01:16.573931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Made reservation on behalf of d41878b5642f44c8a28b650414407a81 for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:16.576497 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Publish callbacks [] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:16.749803 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7882c65e-a8c6-44a1-9a2b-ba49ced5321b req-ca88763e-b43b-4eb6-8cbb-895ca74fa7ae tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:16.751360 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7882c65e-a8c6-44a1-9a2b-ba49ced5321b req-ca88763e-b43b-4eb6-8cbb-895ca74fa7ae tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 944 time: 0.0729737 Nov 18 21:01:16.869235 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7882c65e-a8c6-44a1-9a2b-ba49ced5321b req-15a3fd57-a025-4931-909a-b97362fd8327 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966923 Nov 18 21:01:16.902950 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:17.022496 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Pushing event updated for resources: {'Subnet': ['ID=67bbc66e-8711-42f8-bf2c-d7ce12103373,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:17.036031 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Checking segment: {'id': '9bdbd408-d7a8-4c1f-a2a2-775ff23bede4', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': 'a243042a-74f9-4ab9-8244-32fa08c301a4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:17.036408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Network hostable DHCP agents. Network: a243042a-74f9-4ab9-8244-32fa08c301a4, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:01:17.060548 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd83cc67-5387-469c-9250-7cbdc872c8ab req-e8510239-dd9f-4f8a-b384-e5d89e9d8e75 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1775494 Nov 18 21:01:17.068092 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Network a243042a-74f9-4ab9-8244-32fa08c301a4 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:01:17.078283 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, a243042a-74f9-4ab9-8244-32fa08c301a4) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:17.085847 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:17.085847 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:17.089377 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b69dce32-5021-48fb-a9e2-07f7b745fea1 None None] Network a243042a-74f9-4ab9-8244-32fa08c301a4 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:01:17.122034 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f31bb3ba-554c-46e9-a92c-c711d0c48141 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.5764508 Nov 18 21:01:17.137132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-001455a8-5305-4167-99b2-3abeb8da4fe4 req-dc2a520d-51f9-46c6-b22b-3ebd2fdf7223 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:17.138807 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-001455a8-5305-4167-99b2-3abeb8da4fe4 req-dc2a520d-51f9-46c6-b22b-3ebd2fdf7223 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0561330 Nov 18 21:01:17.189622 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-001455a8-5305-4167-99b2-3abeb8da4fe4 req-1e52764a-5024-4c28-8fdd-47599eac3844 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445046 Nov 18 21:01:17.224922 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-796d19b7-c7b2-4507-b1ba-a8ae63615dce None None] Network a243042a-74f9-4ab9-8244-32fa08c301a4 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:01:17.496421 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-588fed16-d766-4091-90b2-3ad900f884d1 req-c1f2b725-d10d-4e9a-a972-6d78dd82cac6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:17.498227 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-588fed16-d766-4091-90b2-3ad900f884d1 req-c1f2b725-d10d-4e9a-a972-6d78dd82cac6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.0566046 Nov 18 21:01:17.567595 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-588fed16-d766-4091-90b2-3ad900f884d1 req-1a4bcb97-ee47-4f1f-a88c-f7dbf819f222 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614920 Nov 18 21:01:17.604405 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7dd05c0-d5bf-4a18-b611-8a064b041a6d req-3748b6f7-7082-466b-8ea1-2f9df7862b88 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:17.612651 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d7dd05c0-d5bf-4a18-b611-8a064b041a6d req-3748b6f7-7082-466b-8ea1-2f9df7862b88 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 945 time: 0.0721431 Nov 18 21:01:17.666676 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d7dd05c0-d5bf-4a18-b611-8a064b041a6d req-65736f58-68dc-46c7-b139-ee7b0d680ff2 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528302 Nov 18 21:01:18.094766 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69b5ca75-0ecf-410f-990f-a42dbeb3fa90 req-6201a92e-9fec-4136-8d2a-b033a770b4b3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:18.099923 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-69b5ca75-0ecf-410f-990f-a42dbeb3fa90 req-6201a92e-9fec-4136-8d2a-b033a770b4b3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 944 time: 0.0987017 Nov 18 21:01:18.163101 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-69b5ca75-0ecf-410f-990f-a42dbeb3fa90 req-46bd3d61-4130-41dc-8506-d80855ab724b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578935 Nov 18 21:01:18.380465 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-846f0946-1206-42c3-9711-efe0b00c204f req-38461175-1a48-480c-85e4-be287dd90a54 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:18.383120 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-846f0946-1206-42c3-9711-efe0b00c204f req-38461175-1a48-480c-85e4-be287dd90a54 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0844691 Nov 18 21:01:18.467989 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-846f0946-1206-42c3-9711-efe0b00c204f req-5e78bf5d-db03-4721-9291-a66910fc5add tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0762107 Nov 18 21:01:18.740566 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a01a96f-a89f-4287-b0c3-cad580212c85 req-bc6cc13a-deb6-482d-81ed-6a4977a1c2f8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:18.743172 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a01a96f-a89f-4287-b0c3-cad580212c85 req-bc6cc13a-deb6-482d-81ed-6a4977a1c2f8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.0826259 Nov 18 21:01:18.840512 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a01a96f-a89f-4287-b0c3-cad580212c85 req-f9e4cd67-9038-4459-8feb-7f796dcde7d8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903842 Nov 18 21:01:18.865301 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33294793-768f-42dc-a6f4-90f280902469 req-80c993ba-b9db-49e5-b8c8-83fa7d9aa3e3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:18.873464 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-33294793-768f-42dc-a6f4-90f280902469 req-80c993ba-b9db-49e5-b8c8-83fa7d9aa3e3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 945 time: 0.1069171 Nov 18 21:01:18.939172 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-33294793-768f-42dc-a6f4-90f280902469 req-b04422c7-2da6-4648-ad55-e34a67a596b9 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0644686 Nov 18 21:01:19.275970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:19.361677 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74850f6a-a76f-4367-aa1a-2f35bfc59263 req-6eab9eea-d229-437a-b123-20e9f1823d5f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:19.361677 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-74850f6a-a76f-4367-aa1a-2f35bfc59263 req-6eab9eea-d229-437a-b123-20e9f1823d5f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 944 time: 0.0732884 Nov 18 21:01:19.420936 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-74850f6a-a76f-4367-aa1a-2f35bfc59263 req-463c091f-5c15-4651-a8d1-6d4ff9aec2e4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0574911 Nov 18 21:01:19.620903 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90312f8d-45e8-4236-a44d-9404777ac5e6 req-ff6dbdb4-1d04-40de-b1e7-41c76746e5cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:19.623149 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-90312f8d-45e8-4236-a44d-9404777ac5e6 req-ff6dbdb4-1d04-40de-b1e7-41c76746e5cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0632467 Nov 18 21:01:19.685765 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-90312f8d-45e8-4236-a44d-9404777ac5e6 req-4eb1af54-d8a9-4674-876d-3ff26728d3f9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561497 Nov 18 21:01:19.911376 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 67b470ac-d502-4785-a1b3-cabbdf1eaf77 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:19.968446 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65684f82-34ed-4025-935c-bc8a20c9fcb0 req-eb33d869-ae1a-4f74-9c24-12cbee3b2dd4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:19.969178 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:01:19.970113 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-65684f82-34ed-4025-935c-bc8a20c9fcb0 req-eb33d869-ae1a-4f74-9c24-12cbee3b2dd4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.0529611 Nov 18 21:01:19.973703 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:19.974079 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:20.028843 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-65684f82-34ed-4025-935c-bc8a20c9fcb0 req-c119bf7d-c2ff-4c8c-baa8-7ad2c420122e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0520067 Nov 18 21:01:20.058905 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:20.083365 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '67b470ac-d502-4785-a1b3-cabbdf1eaf77'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:20.088182 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-549a7c91-dab3-4212-94c1-8aacbec5b46c req-9ecc2444-5820-4380-a011-b5c64b2861dd tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:20.089940 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-549a7c91-dab3-4212-94c1-8aacbec5b46c req-9ecc2444-5820-4380-a011-b5c64b2861dd tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 945 time: 0.0549691 Nov 18 21:01:20.142011 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-549a7c91-dab3-4212-94c1-8aacbec5b46c req-57799c95-6b54-4c51-93cc-fbd522c16ee6 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0454831 Nov 18 21:01:20.169415 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:20.175439 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:20.176751 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3d1065d4-abc3-48ca-9275-5c415cb3466a up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:20.260123 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=67b470ac-d502-4785-a1b3-cabbdf1eaf77,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:20.271875 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e511988-be54-4be4-a08d-9e81936f41f3" -d '{"events": [{"server_uuid": "372b6983-3b61-4ecd-a186-2a7e7adbcf37", "name": "network-vif-plugged", "status": "completed", "tag": "67b470ac-d502-4785-a1b3-cabbdf1eaf77"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:20.276012 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 3d1065d4-abc3-48ca-9275-5c415cb3466a completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:01:20.280284 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 3d1065d4-abc3-48ca-9275-5c415cb3466a triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:20.280665 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:20.390627 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:20.409141 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a1604461-64ce-4eac-947f-ea5d0a16f7a2 x-openstack-request-id: req-a1604461-64ce-4eac-947f-ea5d0a16f7a2 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:20.425000 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "372b6983-3b61-4ecd-a186-2a7e7adbcf37", "name": "network-vif-plugged", "status": "completed", "tag": "67b470ac-d502-4785-a1b3-cabbdf1eaf77", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:20.425514 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a1604461-64ce-4eac-947f-ea5d0a16f7a2 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:20.426181 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '67b470ac-d502-4785-a1b3-cabbdf1eaf77', 'code': 200} Nov 18 21:01:20.523145 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3d1065d4-abc3-48ca-9275-5c415cb3466a, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a,segment=NetworkSegment(1822c8a3-e235-4644-8a58-074d8932baed),segment_id=1822c8a3-e235-4644-8a58-074d8932baed)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:20.529974 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:20.569722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33542) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:20.615044 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f36102c-f986-4f48-b7d0-0de31c2a79a6 req-b0606bf4-e1b7-4c90-b8fe-df1f5ed35099 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:20.617130 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9f36102c-f986-4f48-b7d0-0de31c2a79a6 req-b0606bf4-e1b7-4c90-b8fe-df1f5ed35099 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0762146 Nov 18 21:01:20.663261 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3d1065d4-abc3-48ca-9275-5c415cb3466a,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:20.754370 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9f36102c-f986-4f48-b7d0-0de31c2a79a6 req-6cec08e5-4dfa-4da9-ba38-58d643bdc746 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1168156 Nov 18 21:01:20.831727 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2397cc03-7b7b-4270-bc36-c6daa244d279 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.080547 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-245e68c8-4436-471b-b644-2b93aab5eb28 req-5234c6b0-7716-4e36-b6eb-3f3702ddfb70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:21.082084 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-245e68c8-4436-471b-b644-2b93aab5eb28 req-5234c6b0-7716-4e36-b6eb-3f3702ddfb70 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 1098 time: 0.4430101 Nov 18 21:01:21.120459 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7b5eb7a-e314-4747-9193-e62fe909efc6 req-5d14fbcd-a16b-4d08-9866-3d37586732dc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:21.121982 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7b5eb7a-e314-4747-9193-e62fe909efc6 req-5d14fbcd-a16b-4d08-9866-3d37586732dc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.2979059 Nov 18 21:01:21.156043 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d53fba6-c870-4078-8cc5-4c85a7476b62 req-f2ef62d6-d753-4be4-8ad8-9c457a429283 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:21.157707 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3d53fba6-c870-4078-8cc5-4c85a7476b62 req-f2ef62d6-d753-4be4-8ad8-9c457a429283 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 944 time: 0.0538659 Nov 18 21:01:21.198748 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2397cc03-7b7b-4270-bc36-c6daa244d279 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.204712 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7b5eb7a-e314-4747-9193-e62fe909efc6 req-b8e0dbb3-6140-4204-81a4-b42678c9e7eb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0751972 Nov 18 21:01:21.209211 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2397cc03-7b7b-4270-bc36-c6daa244d279 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.218214 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3d53fba6-c870-4078-8cc5-4c85a7476b62 req-8762cc8a-28fd-4e05-b331-3ab9323eafd4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539589 Nov 18 21:01:21.255681 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-2397cc03-7b7b-4270-bc36-c6daa244d279 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=fbbd1c89d5c9457c8fc9fade69aae435&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6838472 Nov 18 21:01:21.257104 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2397cc03-7b7b-4270-bc36-c6daa244d279 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47c9659e-e1d9-4b0f-a1cd-d051ba546b82,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:21.258535 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 33568) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:21.314638 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9e53e7a-8be2-4f99-ab86-4d0650531023 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.326424 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cc95031-736f-4161-8d58-5d8fa7454085 req-6f76bab5-b421-40bb-8420-6a270f8d3cde tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:21.327995 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6cc95031-736f-4161-8d58-5d8fa7454085 req-6f76bab5-b421-40bb-8420-6a270f8d3cde tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.0584509 Nov 18 21:01:21.339243 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9e53e7a-8be2-4f99-ab86-4d0650531023 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.381354 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6cc95031-736f-4161-8d58-5d8fa7454085 req-b4941175-c935-4330-bb48-be1a9c729602 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466213 Nov 18 21:01:21.397972 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9e53e7a-8be2-4f99-ab86-4d0650531023 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.401355 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9e53e7a-8be2-4f99-ab86-4d0650531023 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.402545 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f9e53e7a-8be2-4f99-ab86-4d0650531023 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/47c9659e-e1d9-4b0f-a1cd-d051ba546b82 HTTP/1.1" status: 204 len: 168 time: 0.1430037 Nov 18 21:01:21.415756 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9e53e7a-8be2-4f99-ab86-4d0650531023 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47c9659e-e1d9-4b0f-a1cd-d051ba546b82,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:21.718435 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33574) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:21.732963 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-711c4c7b-e5ec-4ce5-870e-8271a62ec17c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.817176 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-711c4c7b-e5ec-4ce5-870e-8271a62ec17c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.822989 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-711c4c7b-e5ec-4ce5-870e-8271a62ec17c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.863148 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-711c4c7b-e5ec-4ce5-870e-8271a62ec17c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd09cb37-09eb-4205-bd81-9652e8b52e97,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:21.869594 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-711c4c7b-e5ec-4ce5-870e-8271a62ec17c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=59b81c1f6f5f4cec8c85c962f3bcde86&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1498661 Nov 18 21:01:21.871256 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33580) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:21.891356 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e12fa33b-c375-4400-ac38-c56683b591b9 req-601f6ec6-aa58-4cb0-869a-88d7cedce06a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:21.892779 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e12fa33b-c375-4400-ac38-c56683b591b9 req-601f6ec6-aa58-4cb0-869a-88d7cedce06a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0718625 Nov 18 21:01:21.945242 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-732926ea-a037-47c9-938a-372627649e0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:21.949964 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e12fa33b-c375-4400-ac38-c56683b591b9 req-ea2ec71d-fd03-4f2a-be27-e32a23100608 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0486648 Nov 18 21:01:21.970736 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-732926ea-a037-47c9-938a-372627649e0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.026947 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-732926ea-a037-47c9-938a-372627649e0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.029749 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-732926ea-a037-47c9-938a-372627649e0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.030973 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-732926ea-a037-47c9-938a-372627649e0f admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/bd09cb37-09eb-4205-bd81-9652e8b52e97 HTTP/1.1" status: 204 len: 168 time: 0.1581783 Nov 18 21:01:22.040547 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-732926ea-a037-47c9-938a-372627649e0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd09cb37-09eb-4205-bd81-9652e8b52e97,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:22.046492 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:01:22.059063 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-245e68c8-4436-471b-b644-2b93aab5eb28 req-5d3b3116-7470-47ec-a283-abf98a4c7a02 service neutron] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.153803 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-245e68c8-4436-471b-b644-2b93aab5eb28 req-5d3b3116-7470-47ec-a283-abf98a4c7a02 service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.162328 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-245e68c8-4436-471b-b644-2b93aab5eb28 req-5d3b3116-7470-47ec-a283-abf98a4c7a02 service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.174676 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:22.188668 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'port_id': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d', 'mac_address': 'fa:16:3e:5d:49:56', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 640, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:01:22.237944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.253872 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-245e68c8-4436-471b-b644-2b93aab5eb28 req-5d3b3116-7470-47ec-a283-abf98a4c7a02 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2090147 Nov 18 21:01:22.254950 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d3b3116-7470-47ec-a283-abf98a4c7a02 service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=3f0ab69c-6255-4cd9-94bf-d8a259b54498,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:22.255800 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:22.287865 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:22.295279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.296746 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:01:22.364323 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d981ab6-b683-4f34-8594-779c59182847 req-8cfac2c8-0f73-4a11-8f9f-92e702c7b725 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:22.366443 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d981ab6-b683-4f34-8594-779c59182847 req-8cfac2c8-0f73-4a11-8f9f-92e702c7b725 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0686162 Nov 18 21:01:22.410687 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-815528f7-1471-4991-889f-26ebb72f1703 req-b46fead4-7d8a-4fc4-8e05-d9e93471c0b2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:22.412802 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-815528f7-1471-4991-889f-26ebb72f1703 req-b46fead4-7d8a-4fc4-8e05-d9e93471c0b2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 945 time: 0.0714436 Nov 18 21:01:22.419274 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:22.427163 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d1065d4-abc3-48ca-9275-5c415cb3466a'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:22.432150 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-741bbf52-5178-43f7-ab82-69d51d0e3be4" -d '{"events": [{"server_uuid": "b957f670-6b5a-4acf-883d-2111d15606e6", "name": "network-vif-plugged", "status": "completed", "tag": "3d1065d4-abc3-48ca-9275-5c415cb3466a"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:22.462260 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d981ab6-b683-4f34-8594-779c59182847 req-b8061dc4-f733-48b0-a0ad-17a929926d3c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0864513 Nov 18 21:01:22.490837 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-815528f7-1471-4991-889f-26ebb72f1703 req-f97c3b42-0456-4495-9589-132f25596d41 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700095 Nov 18 21:01:22.516768 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:22.532485 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '36578666-b0b7-4111-a019-33bc4c0ac780', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780', 'mac_address': 'fa:16:3e:1b:e2:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:01:22.548059 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c892d58a-7720-4db4-89a2-ff232b473b7c x-openstack-request-id: req-c892d58a-7720-4db4-89a2-ff232b473b7c {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:22.548059 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b957f670-6b5a-4acf-883d-2111d15606e6", "name": "network-vif-plugged", "status": "completed", "tag": "3d1065d4-abc3-48ca-9275-5c415cb3466a", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:22.548357 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c892d58a-7720-4db4-89a2-ff232b473b7c {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:22.548707 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3d1065d4-abc3-48ca-9275-5c415cb3466a', 'code': 200} Nov 18 21:01:22.584349 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.605228 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36578666-b0b7-4111-a019-33bc4c0ac780 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:22.627903 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0292d437-e9e7-4d05-9f0e-95cab03ca97a req-4434af3d-291d-428a-8165-2c98c01fa25c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:22.630782 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0292d437-e9e7-4d05-9f0e-95cab03ca97a req-4434af3d-291d-428a-8165-2c98c01fa25c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.0913863 Nov 18 21:01:22.631143 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:22.637709 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.638469 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 618d8033-6b64-42ec-805f-1007401fc720 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:01:22.709686 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 618d8033-6b64-42ec-805f-1007401fc720, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=618d8033-6b64-42ec-805f-1007401fc720,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:22.712199 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0292d437-e9e7-4d05-9f0e-95cab03ca97a req-0419e49f-0cf2-4aec-adb4-fd9fa0d162a3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704336 Nov 18 21:01:22.712447 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:22.724783 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '618d8033-6b64-42ec-805f-1007401fc720', 'network_id': '5973daa9-793c-40f5-972b-25507ee923a3', 'port_id': '618d8033-6b64-42ec-805f-1007401fc720', 'mac_address': 'fa:16:3e:d0:53:9c', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 640, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ecbb94e2-6852-471b-9339-07ed4834cbe7', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:01:22.771870 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.786213 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 618d8033-6b64-42ec-805f-1007401fc720 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:01:22.809874 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 618d8033-6b64-42ec-805f-1007401fc720, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=618d8033-6b64-42ec-805f-1007401fc720,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:22.815403 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:22.872557 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=618d8033-6b64-42ec-805f-1007401fc720,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:23.081322 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b843177f-9ff6-49cc-b26d-4adaf1764a51 req-25871768-ea98-41eb-8aa7-0f392e21f9b2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:23.082969 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b843177f-9ff6-49cc-b26d-4adaf1764a51 req-25871768-ea98-41eb-8aa7-0f392e21f9b2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0570080 Nov 18 21:01:23.138811 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b843177f-9ff6-49cc-b26d-4adaf1764a51 req-2e26c639-4701-4521-9af2-8788c4c70dd1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0484595 Nov 18 21:01:23.584811 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdf69a78-8bf0-444d-bec9-11285c8b7a08 req-d49ec1d6-fa41-4a7d-9336-65b183bc5673 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:23.587003 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bdf69a78-8bf0-444d-bec9-11285c8b7a08 req-d49ec1d6-fa41-4a7d-9336-65b183bc5673 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.0518250 Nov 18 21:01:23.619495 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76fd43a5-648e-4a60-aadf-b3967076aed3 req-978fe6bd-a137-49a9-b013-fe1e43858512 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:23.621097 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-76fd43a5-648e-4a60-aadf-b3967076aed3 req-978fe6bd-a137-49a9-b013-fe1e43858512 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 945 time: 0.0599566 Nov 18 21:01:23.653659 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bdf69a78-8bf0-444d-bec9-11285c8b7a08 req-db3e4166-ce33-465f-8fff-99b4e07f7acd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0598075 Nov 18 21:01:23.672216 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-76fd43a5-648e-4a60-aadf-b3967076aed3 req-82ac72f4-0ce5-4b05-93c5-7c610a4b3913 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447822 Nov 18 21:01:23.835312 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5880f7e2-a12c-4f32-a1bf-aa3bbad86c41 req-c42cbc14-c120-4b79-90e3-a04455262992 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:23.837318 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5880f7e2-a12c-4f32-a1bf-aa3bbad86c41 req-c42cbc14-c120-4b79-90e3-a04455262992 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.0536582 Nov 18 21:01:23.891426 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5880f7e2-a12c-4f32-a1bf-aa3bbad86c41 req-bb24ae65-11b3-4b78-9714-9602936c3fa3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0469379 Nov 18 21:01:24.291454 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2a6062f-ede8-4c13-bf55-2aec1ab99ead req-e204f6a5-0ba6-480e-a6aa-42202608cc26 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:24.293112 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b2a6062f-ede8-4c13-bf55-2aec1ab99ead req-e204f6a5-0ba6-480e-a6aa-42202608cc26 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0585425 Nov 18 21:01:24.384991 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b2a6062f-ede8-4c13-bf55-2aec1ab99ead req-3005ffb5-95e7-4d84-8911-effd8626a95e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804093 Nov 18 21:01:24.516136 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['618d8033-6b64-42ec-805f-1007401fc720'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:01:24.561484 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['36578666-b0b7-4111-a019-33bc4c0ac780'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:01:24.576714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:01:24.617237 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d874b6ee-648c-4dc3-8d20-3ad298f03002 req-356fdec6-6e8c-43b1-abbb-4b97b5278eab service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:24.618813 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d874b6ee-648c-4dc3-8d20-3ad298f03002 req-356fdec6-6e8c-43b1-abbb-4b97b5278eab service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 1099 time: 0.0471277 Nov 18 21:01:24.683847 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d874b6ee-648c-4dc3-8d20-3ad298f03002 req-285b943a-6a07-4774-89f0-c0d8dfea9214 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0558453 Nov 18 21:01:24.813685 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6713da5-227a-4470-9e03-2f1a4f09ccf4 req-cdf566d9-d8cb-4702-b26e-0cb607af6ee6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:24.815423 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b6713da5-227a-4470-9e03-2f1a4f09ccf4 req-cdf566d9-d8cb-4702-b26e-0cb607af6ee6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.0508316 Nov 18 21:01:24.843649 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c88c4d5-6b4e-49de-9c25-53ee60e6ccd5 req-223c18e8-6905-41b9-8373-437bc81d70e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:24.847161 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9c88c4d5-6b4e-49de-9c25-53ee60e6ccd5 req-223c18e8-6905-41b9-8373-437bc81d70e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 945 time: 0.0648406 Nov 18 21:01:24.875108 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b6713da5-227a-4470-9e03-2f1a4f09ccf4 req-2483cd2c-07eb-4e16-9be4-56698357c733 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520761 Nov 18 21:01:24.906656 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9c88c4d5-6b4e-49de-9c25-53ee60e6ccd5 req-9f3042ea-fcf0-4b20-b4a7-78ba7f557943 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535657 Nov 18 21:01:25.053470 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f4fa966-e042-4006-a1d5-c0de18e368d3 req-64b31fad-8f4f-4934-befa-7c4497dda57e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:25.062596 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f4fa966-e042-4006-a1d5-c0de18e368d3 req-64b31fad-8f4f-4934-befa-7c4497dda57e tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.0879059 Nov 18 21:01:25.122796 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f4fa966-e042-4006-a1d5-c0de18e368d3 req-4ec358ad-8740-4287-99de-f3f612ab135d tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590246 Nov 18 21:01:25.598641 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bebe855a-f59a-4ba2-9d4a-a6c4c1fcc438 req-6dae8cf9-26b1-4e0d-a442-11f83a9a8ee5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:25.605170 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bebe855a-f59a-4ba2-9d4a-a6c4c1fcc438 req-6dae8cf9-26b1-4e0d-a442-11f83a9a8ee5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0956662 Nov 18 21:01:25.684850 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bebe855a-f59a-4ba2-9d4a-a6c4c1fcc438 req-fa679a89-cfec-483e-9911-6afa559cef76 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0708947 Nov 18 21:01:26.050461 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8ba4668-7e41-4417-876f-4dd4ba8f69bf req-7d8993de-c1ac-4e05-934a-ae154a6ca302 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:26.052242 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d8ba4668-7e41-4417-876f-4dd4ba8f69bf req-7d8993de-c1ac-4e05-934a-ae154a6ca302 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 945 time: 0.0548189 Nov 18 21:01:26.052433 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d99fa56-9131-4581-aece-931e5dfadd2b req-2e037085-3e58-44cc-b64b-503a79007911 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:26.054803 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d99fa56-9131-4581-aece-931e5dfadd2b req-2e037085-3e58-44cc-b64b-503a79007911 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.0757723 Nov 18 21:01:26.061854 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:26.151101 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 36578666-b0b7-4111-a019-33bc4c0ac780 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:01:26.156525 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d8ba4668-7e41-4417-876f-4dd4ba8f69bf req-fcbcdb05-fd14-434d-8303-4854c2bb8313 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0860693 Nov 18 21:01:26.159843 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d99fa56-9131-4581-aece-931e5dfadd2b req-c07efe11-159e-4c94-a36f-0d4c78336092 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0904531 Nov 18 21:01:26.169927 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 36578666-b0b7-4111-a019-33bc4c0ac780 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:26.170108 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:26.341847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96b09d83-1782-44ab-b605-8d9596b95e9b req-a8b4ae71-2568-4a24-bc5e-252e819d11b3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:26.343192 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:26.343453 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-96b09d83-1782-44ab-b605-8d9596b95e9b req-a8b4ae71-2568-4a24-bc5e-252e819d11b3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.0979185 Nov 18 21:01:26.449452 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-96b09d83-1782-44ab-b605-8d9596b95e9b req-7d728520-28c4-4e26-ba87-330256824a91 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971482 Nov 18 21:01:26.507887 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:26.511508 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7a6c4927-18bc-4816-b5d4-3484ac5f8621" -d '{"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:26.531171 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:26.537789 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:26.539690 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 618d8033-6b64-42ec-805f-1007401fc720 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:26.605339 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09fcf084-c574-4b77-98e8-da13f5f5267f x-openstack-request-id: req-09fcf084-c574-4b77-98e8-da13f5f5267f {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:26.605832 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:26.606264 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-09fcf084-c574-4b77-98e8-da13f5f5267f {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:26.606902 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'code': 200} Nov 18 21:01:26.730399 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:26.763782 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 618d8033-6b64-42ec-805f-1007401fc720 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:01:26.779553 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 618d8033-6b64-42ec-805f-1007401fc720 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:26.780279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:27.065933 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:27.097884 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7425eef0-489e-4934-97a1-45e49e9ef3aa req-834a0fd0-b09a-4691-9321-dd64cd564649 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:27.103593 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7425eef0-489e-4934-97a1-45e49e9ef3aa req-834a0fd0-b09a-4691-9321-dd64cd564649 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.1711454 Nov 18 21:01:27.140556 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32bd0118-bad3-4ce0-b2f6-be1e03d915ee req-82ecabf7-0fde-410d-914a-f567dd1bb396 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:27.143567 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-32bd0118-bad3-4ce0-b2f6-be1e03d915ee req-82ecabf7-0fde-410d-914a-f567dd1bb396 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1099 time: 0.1405499 Nov 18 21:01:27.214074 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 618d8033-6b64-42ec-805f-1007401fc720, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=618d8033-6b64-42ec-805f-1007401fc720,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:27.234981 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:27.255532 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7425eef0-489e-4934-97a1-45e49e9ef3aa req-d48ef322-b8a0-49ec-ba78-fb6bf161eebb tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1335754 Nov 18 21:01:27.355905 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=618d8033-6b64-42ec-805f-1007401fc720,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:27.375009 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-32bd0118-bad3-4ce0-b2f6-be1e03d915ee req-66445098-f343-4d39-9122-92e2ddfaa81d service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2209938 Nov 18 21:01:27.456626 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9a0b8f3-3447-4056-9462-dd3bec8dda69 req-0ceede92-29e9-42ba-a5eb-4e2849441753 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:27.458345 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f9a0b8f3-3447-4056-9462-dd3bec8dda69 req-0ceede92-29e9-42ba-a5eb-4e2849441753 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1253440 Nov 18 21:01:27.465832 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b51597a2-e83a-4b3b-b000-a5138269ed6e req-c8048e9d-bee4-40e4-9969-acfc1112e5d7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:27.469235 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b51597a2-e83a-4b3b-b000-a5138269ed6e req-c8048e9d-bee4-40e4-9969-acfc1112e5d7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 945 time: 0.0890009 Nov 18 21:01:27.532894 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b51597a2-e83a-4b3b-b000-a5138269ed6e req-b594fd12-864b-466e-9447-c70741c4e3a0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552402 Nov 18 21:01:27.543428 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f9a0b8f3-3447-4056-9462-dd3bec8dda69 req-febbe930-ad6a-40e1-bcdb-6fdf63bb99d2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0777895 Nov 18 21:01:27.668172 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b81740cd-e580-4255-af92-1b30ca78723f req-06250a48-e37e-46c4-b75a-8ee32d7d2fc3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:27.670014 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b81740cd-e580-4255-af92-1b30ca78723f req-06250a48-e37e-46c4-b75a-8ee32d7d2fc3 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.0554523 Nov 18 21:01:27.723511 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b81740cd-e580-4255-af92-1b30ca78723f req-0e2aac30-b98a-4676-985d-1fb7a4904fb0 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0466704 Nov 18 21:01:27.835506 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33778) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:27.987316 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fd40e6ba-e533-4f6b-83ce-26425b10c04e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.097876 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fd40e6ba-e533-4f6b-83ce-26425b10c04e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.104299 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fd40e6ba-e533-4f6b-83ce-26425b10c04e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.152879 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-fd40e6ba-e533-4f6b-83ce-26425b10c04e admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=feeb743021204e079bede5592e7d1b91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3159792 Nov 18 21:01:28.154693 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fd40e6ba-e533-4f6b-83ce-26425b10c04e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e684e002-05d3-4da8-94d1-7bb8b39d90b9,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:28.155831 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 33788) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:28.213092 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cf712b64-af0d-41c6-b57e-71d866c5ee36 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.236575 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cf712b64-af0d-41c6-b57e-71d866c5ee36 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.290220 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cf712b64-af0d-41c6-b57e-71d866c5ee36 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.294780 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cf712b64-af0d-41c6-b57e-71d866c5ee36 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:28.296797 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cf712b64-af0d-41c6-b57e-71d866c5ee36 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/e684e002-05d3-4da8-94d1-7bb8b39d90b9 HTTP/1.1" status: 204 len: 168 time: 0.1396792 Nov 18 21:01:28.310179 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf712b64-af0d-41c6-b57e-71d866c5ee36 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e684e002-05d3-4da8-94d1-7bb8b39d90b9,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:28.420047 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f159fb-2105-49f6-acb4-a6f4ed87eb2f req-9fe03a93-ce4f-4c75-b0d8-e83f65852d8c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:28.420047 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-72f159fb-2105-49f6-acb4-a6f4ed87eb2f req-9fe03a93-ce4f-4c75-b0d8-e83f65852d8c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0794570 Nov 18 21:01:28.473462 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-72f159fb-2105-49f6-acb4-a6f4ed87eb2f req-26d09186-c15b-4b3c-b8ca-630be6c85cf8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0490074 Nov 18 21:01:28.608988 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '618d8033-6b64-42ec-805f-1007401fc720'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:28.611469 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3af5c7b-8551-4ba8-92df-ceafcfb5f7c2" -d '{"events": [{"server_uuid": "6956f4de-9dd5-4438-a7d9-fb2e1b228343", "name": "network-vif-plugged", "status": "completed", "tag": "618d8033-6b64-42ec-805f-1007401fc720"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:28.680488 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05825233-97c5-4284-a087-fe09a108cb3e req-1818bb7e-49aa-4b43-a067-66be4291dc1b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:28.682772 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-05825233-97c5-4284-a087-fe09a108cb3e req-1818bb7e-49aa-4b43-a067-66be4291dc1b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 945 time: 0.0656171 Nov 18 21:01:28.758327 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:01:28.770007 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-05825233-97c5-4284-a087-fe09a108cb3e req-af9fa5d9-7aa6-41e4-8a08-9bb42b6e1f29 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817800 Nov 18 21:01:28.824788 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-18750267-160e-4a18-b047-775d5b283a2f x-openstack-request-id: req-18750267-160e-4a18-b047-775d5b283a2f {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:28.825169 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6956f4de-9dd5-4438-a7d9-fb2e1b228343", "name": "network-vif-plugged", "status": "completed", "tag": "618d8033-6b64-42ec-805f-1007401fc720", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:28.825482 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-18750267-160e-4a18-b047-775d5b283a2f {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:28.825913 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '618d8033-6b64-42ec-805f-1007401fc720', 'code': 200} Nov 18 21:01:28.827789 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9dc2a79f-f8e1-4df6-9864-656d3f3ef67e req-79ddc255-4321-48c8-9970-1f0a2c9dc126 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:28.831763 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9dc2a79f-f8e1-4df6-9864-656d3f3ef67e req-79ddc255-4321-48c8-9970-1f0a2c9dc126 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1579759 Nov 18 21:01:28.961077 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9dc2a79f-f8e1-4df6-9864-656d3f3ef67e req-25d149ba-10bd-4f2c-bd5b-a0e3ac3f67ba tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1157610 Nov 18 21:01:29.088634 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:29.161470 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:01:29.167620 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:29.168270 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:29.282959 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:29.322256 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:29.328947 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:29.386148 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:29.881246 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82fc0887-8bb5-4e3f-bc12-6a9224ab8e04 req-8e789c2e-888b-4221-b2c2-bbe31dd41fc1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:29.882800 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82fc0887-8bb5-4e3f-bc12-6a9224ab8e04 req-8e789c2e-888b-4221-b2c2-bbe31dd41fc1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0511324 Nov 18 21:01:29.941061 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82fc0887-8bb5-4e3f-bc12-6a9224ab8e04 req-3605aca9-6f20-4ed1-af6b-5cd6a1c3fb6d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0509057 Nov 18 21:01:30.081546 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0234616b-b20c-45b8-b61c-bd703911bfa6 req-4c067cda-4b6a-4879-9bac-8c2bb3d64d75 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:30.083027 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0234616b-b20c-45b8-b61c-bd703911bfa6 req-4c067cda-4b6a-4879-9bac-8c2bb3d64d75 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0537646 Nov 18 21:01:30.135122 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0234616b-b20c-45b8-b61c-bd703911bfa6 req-1a72683c-df35-4119-802f-a3a7d08e8f40 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448949 Nov 18 21:01:30.752773 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f54b6211-5ff2-4146-8923-2a485615a1e6 req-6dca607b-03c9-4dd8-9291-753a6485939f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:30.755247 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f54b6211-5ff2-4146-8923-2a485615a1e6 req-6dca607b-03c9-4dd8-9291-753a6485939f service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.0688632 Nov 18 21:01:30.814878 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f54b6211-5ff2-4146-8923-2a485615a1e6 req-e7f75b30-1f35-447a-ab50-6d1387d4c960 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516579 Nov 18 21:01:30.827374 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3434e796-377f-4682-8853-5949c8a1e5f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:30.831636 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd8be757-75ff-486f-9125-7f989a9cb0b9" -d '{"events": [{"server_uuid": "3434e796-377f-4682-8853-5949c8a1e5f3", "name": "network-vif-plugged", "status": "completed", "tag": "972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:30.876645 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8b081b55-dff4-4ac4-acc1-311a631049dc x-openstack-request-id: req-8b081b55-dff4-4ac4-acc1-311a631049dc {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:30.877004 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3434e796-377f-4682-8853-5949c8a1e5f3", "name": "network-vif-plugged", "status": "completed", "tag": "972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:30.877318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-8b081b55-dff4-4ac4-acc1-311a631049dc {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:30.877748 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3434e796-377f-4682-8853-5949c8a1e5f3', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d', 'code': 200} Nov 18 21:01:31.131896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f212438-767f-480f-928e-1ba9e4fed358 req-4170dd91-cbce-4d7e-aadb-3b41ab2047b1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:31.140699 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f212438-767f-480f-928e-1ba9e4fed358 req-4170dd91-cbce-4d7e-aadb-3b41ab2047b1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1187682 Nov 18 21:01:31.241443 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f212438-767f-480f-928e-1ba9e4fed358 req-47d82b99-dec2-4e1f-a901-1b724fb90a12 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981328 Nov 18 21:01:31.359883 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cdba6b6-e380-486c-abd5-321f6d0976d4 req-ce8668f5-dc75-4cdf-a836-4018f49da1b3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:31.362332 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4cdba6b6-e380-486c-abd5-321f6d0976d4 req-ce8668f5-dc75-4cdf-a836-4018f49da1b3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0981810 Nov 18 21:01:31.378780 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-064ea7cf-36e3-4ba0-b4ee-e7106be3caae req-2ae7949d-7cc7-463c-a993-6f661f5a9855 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:31.381428 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-064ea7cf-36e3-4ba0-b4ee-e7106be3caae req-2ae7949d-7cc7-463c-a993-6f661f5a9855 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 1099 time: 0.0758419 Nov 18 21:01:31.448056 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-064ea7cf-36e3-4ba0-b4ee-e7106be3caae req-f38c95ee-f50c-4b08-a2ca-3cb861109c26 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0554266 Nov 18 21:01:31.452532 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4cdba6b6-e380-486c-abd5-321f6d0976d4 req-2fc3db6c-06b0-4922-a4dd-74db22338f9a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0780911 Nov 18 21:01:32.196769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a0d9416f-1073-48ef-9395-319dcdf7bfe1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:32.534969 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4cf851c-2a3c-4bbe-8a80-33c27a5747d5 req-4f6095cb-fa3c-485a-b6fe-7983e02b019a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:32.538455 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b4cf851c-2a3c-4bbe-8a80-33c27a5747d5 req-4f6095cb-fa3c-485a-b6fe-7983e02b019a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1317458 Nov 18 21:01:32.662036 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b4cf851c-2a3c-4bbe-8a80-33c27a5747d5 req-cdb3f710-69eb-4792-9e73-8e425c1fd721 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1117296 Nov 18 21:01:32.879694 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b315c16-4264-400c-887a-210311dd30b7 req-932ad47f-50c0-418c-977b-11c615a211af tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:32.883373 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6b315c16-4264-400c-887a-210311dd30b7 req-932ad47f-50c0-418c-977b-11c615a211af tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1035671 Nov 18 21:01:32.962577 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6b315c16-4264-400c-887a-210311dd30b7 req-2fd489f8-2810-437a-beaf-f4b06150ecbd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0682073 Nov 18 21:01:33.389812 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 33976) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:33.589518 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c44f39f9-c65a-48ec-8a43-a71a5e430230 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:33.779012 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c44f39f9-c65a-48ec-8a43-a71a5e430230 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:33.784256 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c44f39f9-c65a-48ec-8a43-a71a5e430230 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:33.827691 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c44f39f9-c65a-48ec-8a43-a71a5e430230 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=969048cdf60543d89b0e825783683316&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4362257 Nov 18 21:01:33.829077 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c44f39f9-c65a-48ec-8a43-a71a5e430230 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cc3bec36-c590-4624-bb89-8cc2cf3dc36c,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:33.831809 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 33988) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:33.906707 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8600a5cb-e9c2-488c-a534-d65be11cb1a0 req-4bce104a-223a-4e85-81aa-2c323e00f1a0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:33.911050 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8600a5cb-e9c2-488c-a534-d65be11cb1a0 req-4bce104a-223a-4e85-81aa-2c323e00f1a0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1245346 Nov 18 21:01:33.925853 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c3ade8b4-d2d9-480f-9720-0ceea207e38d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:33.963717 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c3ade8b4-d2d9-480f-9720-0ceea207e38d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:33.995734 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 33994) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:34.017181 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8600a5cb-e9c2-488c-a534-d65be11cb1a0 req-32960ba4-0100-4eb1-8737-18e6c018ff28 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0932777 Nov 18 21:01:34.033850 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c3ade8b4-d2d9-480f-9720-0ceea207e38d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.036674 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c3ade8b4-d2d9-480f-9720-0ceea207e38d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.038029 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c3ade8b4-d2d9-480f-9720-0ceea207e38d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/cc3bec36-c590-4624-bb89-8cc2cf3dc36c HTTP/1.1" status: 204 len: 168 time: 0.2049713 Nov 18 21:01:34.052380 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3ade8b4-d2d9-480f-9720-0ceea207e38d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cc3bec36-c590-4624-bb89-8cc2cf3dc36c,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:34.190701 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d43a9bc8-c570-4554-ac12-7530a00727e9 req-fd40e927-e5ea-4a22-a665-536fe9e08640 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:34.192071 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d43a9bc8-c570-4554-ac12-7530a00727e9 req-fd40e927-e5ea-4a22-a665-536fe9e08640 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0850890 Nov 18 21:01:34.259985 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d43a9bc8-c570-4554-ac12-7530a00727e9 req-a919a088-ccd8-4d16-a207-3aba94f46b6a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0566118 Nov 18 21:01:34.425336 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f2f031d8-cd18-4290-a9de-59cf2f8fddd1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.472854 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34006) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:34.478309 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4ca2854-a795-41c3-92fb-88427b3e3e44 req-50f634f5-e28f-46f3-849c-1675f136a7ed tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:34.480567 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f4ca2854-a795-41c3-92fb-88427b3e3e44 req-50f634f5-e28f-46f3-849c-1675f136a7ed tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1396098 Nov 18 21:01:34.487636 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cfbf0506-28b0-45d6-b0b0-038c7b35e174 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.493477 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34008) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:34.501478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'floatingip': {'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:34.577735 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f2f031d8-cd18-4290-a9de-59cf2f8fddd1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.583082 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f2f031d8-cd18-4290-a9de-59cf2f8fddd1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.615612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.628773 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2f031d8-cd18-4290-a9de-59cf2f8fddd1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=011acc57-338d-40c3-aff0-67f4492d9919,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:34.633664 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f2f031d8-cd18-4290-a9de-59cf2f8fddd1 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c87069cd82984436aa6171deb6edeaf4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6357093 Nov 18 21:01:34.641429 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34014) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:34.651619 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-22f0c7b2-cab3-45f8-91b5-57bd4d98cf59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.727490 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-80e74b0b-cb91-49ba-8a4b-40211b24c55e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.761096 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-80e74b0b-cb91-49ba-8a4b-40211b24c55e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.841937 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-80e74b0b-cb91-49ba-8a4b-40211b24c55e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.845070 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-80e74b0b-cb91-49ba-8a4b-40211b24c55e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.846466 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-80e74b0b-cb91-49ba-8a4b-40211b24c55e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/011acc57-338d-40c3-aff0-67f4492d9919 HTTP/1.1" status: 204 len: 168 time: 0.2035761 Nov 18 21:01:34.857032 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e74b0b-cb91-49ba-8a4b-40211b24c55e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=011acc57-338d-40c3-aff0-67f4492d9919,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:34.963721 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cfbf0506-28b0-45d6-b0b0-038c7b35e174 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:34.971771 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cfbf0506-28b0-45d6-b0b0-038c7b35e174 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:35.077964 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cfbf0506-28b0-45d6-b0b0-038c7b35e174 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=04326a83-f00a-42ea-b8ba-3a2adfbab2ff,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:35.136340 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cfbf0506-28b0-45d6-b0b0-038c7b35e174 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=0fb518e6c15b4da5b8a1d3cf04a3c1c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6620219 Nov 18 21:01:35.140613 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34026) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:35.236151 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fa058b38-13d1-4979-adbd-a935f7e985f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:35.266306 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fa058b38-13d1-4979-adbd-a935f7e985f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:35.370157 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fa058b38-13d1-4979-adbd-a935f7e985f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:35.375285 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fa058b38-13d1-4979-adbd-a935f7e985f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:35.377046 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-fa058b38-13d1-4979-adbd-a935f7e985f6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/04326a83-f00a-42ea-b8ba-3a2adfbab2ff HTTP/1.1" status: 204 len: 168 time: 0.2347898 Nov 18 21:01:35.409535 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa058b38-13d1-4979-adbd-a935f7e985f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=04326a83-f00a-42ea-b8ba-3a2adfbab2ff,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:35.920386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b4a41cb-9f6e-4ab5-88d7-24d6dc509628 req-8239a45f-06fa-4361-b9f0-e1b038c816a8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:35.924025 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b4a41cb-9f6e-4ab5-88d7-24d6dc509628 req-8239a45f-06fa-4361-b9f0-e1b038c816a8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.7819164 Nov 18 21:01:35.994006 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:36.103084 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.db.resource_extend [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] It took 0.17 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 21:01:36.257028 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b4a41cb-9f6e-4ab5-88d7-24d6dc509628 req-1c4943de-8ae6-4284-9073-f01a5a3020fb tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2352374 Nov 18 21:01:36.259215 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:36.267278 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:36.421359 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Floating IP b43a547e-8a0b-4ccc-91af-2bacb1f171f0 associated. External IP: 172.27.3.120, port: 36578666-b0b7-4111-a019-33bc4c0ac780. Nov 18 21:01:36.796417 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:01:37.001017 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:01:37.015191 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:37.034346 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:01:37.064310 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e4b47d83-8894-4fde-a1fe-b3cbfa68f0a1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "PUT /v2.0/floatingips/b43a547e-8a0b-4ccc-91af-2bacb1f171f0 HTTP/1.1" status: 200 len: 992 time: 2.5694420 Nov 18 21:01:37.066085 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:01:37.067328 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:01:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:37.068369 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:01:37.075037 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2016178f-af54-4cbc-88ad-a99813de1e6b" -d '{"events": [{"name": "network-changed", "server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:01:37.185902 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:01:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94b253a6-e292-4165-9e68-16c454b3d50a x-openstack-request-id: req-94b253a6-e292-4165-9e68-16c454b3d50a {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:01:37.186242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:01:37.186624 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-94b253a6-e292-4165-9e68-16c454b3d50a {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:01:37.187304 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'status': 'completed', 'code': 200} Nov 18 21:01:37.364527 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:01:37.443825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:37.519856 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71d683c5-aa99-462d-b60a-875f4689c47f req-56eeba25-5865-4d03-95ee-b1c5284c526e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:37.525502 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-71d683c5-aa99-462d-b60a-875f4689c47f req-56eeba25-5865-4d03-95ee-b1c5284c526e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1054900 Nov 18 21:01:37.593560 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-71d683c5-aa99-462d-b60a-875f4689c47f req-b4c28efb-d528-49c6-b576-763a825144ef tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0612319 Nov 18 21:01:37.713300 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-5b622464-ce5e-4883-81b1-37242cfacc34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:37.716439 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-5b622464-ce5e-4883-81b1-37242cfacc34 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1099 time: 0.0750694 Nov 18 21:01:37.861391 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'b43a547e-8a0b-4ccc-91af-2bacb1f171f0', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'floating_ip_address': '172.27.3.120', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'mac_address': 'fa:16:3e:1b:e2:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:01:01Z', 'updated_at': '2021-11-18T21:01:35Z', 'revision_number': 1, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:37.918198 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:01:37.936027 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:01:37.938312 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:01:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:37.978041 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-92c5dc62-c908-4818-94e5-9161d163dac5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:37.981200 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-92c5dc62-c908-4818-94e5-9161d163dac5 service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.2340088 Nov 18 21:01:38.144883 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:01:38.182941 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-443c6eec-cbd3-4b8f-92e2-f0bc58257338 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 200 len: 1000 time: 0.1702340 Nov 18 21:01:38.245275 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:38.275475 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-3373b714-dd39-4716-93e0-874872696000 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:38.278110 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-3373b714-dd39-4716-93e0-874872696000 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0803590 Nov 18 21:01:38.362691 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-fec13b84-6bf9-4e9f-9902-1a32475c705b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:38.367464 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-fec13b84-6bf9-4e9f-9902-1a32475c705b service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0658190 Nov 18 21:01:38.531196 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-d917cea8-2769-4e26-a9e5-ea3932298c9f service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1436210 Nov 18 21:01:38.566213 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'b43a547e-8a0b-4ccc-91af-2bacb1f171f0', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'floating_ip_address': '172.27.3.120', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'mac_address': 'fa:16:3e:1b:e2:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:01:01Z', 'updated_at': '2021-11-18T21:01:35Z', 'revision_number': 1, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:38.621699 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ea63fce-5ba2-4426-93f5-e5fc9abc1fa1 None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'b43a547e-8a0b-4ccc-91af-2bacb1f171f0', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'floating_ip_address': '172.27.3.120', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'mac_address': 'fa:16:3e:1b:e2:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:01:01Z', 'updated_at': '2021-11-18T21:01:35Z', 'revision_number': 1, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:01:38.667965 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2016178f-af54-4cbc-88ad-a99813de1e6b req-45c20f28-234a-40f5-979f-4dcc295f72e7 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1208143 Nov 18 21:01:38.821261 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b25c1cd-45b2-4fd6-bbd7-aa0a8164b65f req-e87829bf-c68a-4607-8a14-452340fb5758 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:38.823637 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8b25c1cd-45b2-4fd6-bbd7-aa0a8164b65f req-e87829bf-c68a-4607-8a14-452340fb5758 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0796573 Nov 18 21:01:38.915496 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8b25c1cd-45b2-4fd6-bbd7-aa0a8164b65f req-8ea6d3d2-73c7-40ed-b301-63a69e0a134c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0777287 Nov 18 21:01:38.965675 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37890773-3762-47a1-bce5-1cdc740c70cf None None] New status for floating IP b43a547e-8a0b-4ccc-91af-2bacb1f171f0: ACTIVE {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:01:39.615058 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f23b3d7a-316c-47ef-a1ac-fef6d10db0c6 req-44cc05b0-3f0d-4071-9f80-a7c69ebe29d2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:39.627665 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f23b3d7a-316c-47ef-a1ac-fef6d10db0c6 req-44cc05b0-3f0d-4071-9f80-a7c69ebe29d2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2019920 Nov 18 21:01:39.633224 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7766394a-da13-4536-9115-6e89e4309e99 req-55ee6a8f-c4be-46cf-ad26-a13f2f37faa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:39.635038 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-55ee6a8f-c4be-46cf-ad26-a13f2f37faa2 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 1099 time: 0.1899495 Nov 18 21:01:39.760940 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f23b3d7a-316c-47ef-a1ac-fef6d10db0c6 req-fcfea42b-0b79-40ab-a265-1b3a542a85e2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1316321 Nov 18 21:01:39.794233 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7766394a-da13-4536-9115-6e89e4309e99 req-2a45f033-0301-4f25-8592-244bd81f05d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:39.795888 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-2a45f033-0301-4f25-8592-244bd81f05d2 service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 0.1368558 Nov 18 21:01:39.874845 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-7bae5092-8954-4dd9-aa15-74927ec79f91 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d HTTP/1.1" status: 200 len: 217 time: 0.0617628 Nov 18 21:01:39.956459 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7766394a-da13-4536-9115-6e89e4309e99 req-6c1c3d26-0c60-4acf-af79-a44ea1e9155e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:39.958067 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-6c1c3d26-0c60-4acf-af79-a44ea1e9155e service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.0744224 Nov 18 21:01:39.999915 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-d226f596-fa56-4ae1-8f53-8ac14092b33f service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0247223 Nov 18 21:01:40.101617 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-f189f202-f153-47f3-8558-7cdff8327bb7 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0868795 Nov 18 21:01:40.235933 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7766394a-da13-4536-9115-6e89e4309e99 req-17a69a0a-6465-46bd-bee2-fc3a6af109cc service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1190512 Nov 18 21:01:40.941997 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d98018b-b513-4a2d-bdbd-cfbff470806d req-55834cd5-9f99-488e-8881-d056820d33f8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:40.944588 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3d98018b-b513-4a2d-bdbd-cfbff470806d req-55834cd5-9f99-488e-8881-d056820d33f8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0752137 Nov 18 21:01:40.996185 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3d98018b-b513-4a2d-bdbd-cfbff470806d req-2836d30c-3202-4d7c-8671-de4a3b46898e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445917 Nov 18 21:01:42.146800 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55fd4ce3-ad1f-4720-9d18-d2e3f72238f4 req-f4ba033c-5ee0-4529-8540-77d7ccfac120 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:42.150384 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-55fd4ce3-ad1f-4720-9d18-d2e3f72238f4 req-f4ba033c-5ee0-4529-8540-77d7ccfac120 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0688996 Nov 18 21:01:42.225523 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-55fd4ce3-ad1f-4720-9d18-d2e3f72238f4 req-727f1c07-e158-4dcc-89e7-53a6b088f6c8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0682065 Nov 18 21:01:43.365718 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d209cf6-3a5d-4237-bc95-2339e31ae0d6 req-75d66c62-3a83-4c41-ab58-852b9b267b5d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:43.367792 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1d209cf6-3a5d-4237-bc95-2339e31ae0d6 req-75d66c62-3a83-4c41-ab58-852b9b267b5d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0537241 Nov 18 21:01:43.427434 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1d209cf6-3a5d-4237-bc95-2339e31ae0d6 req-eca89e41-8ee1-4b6a-93b2-c7d409621bf2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0516183 Nov 18 21:01:44.610873 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa74797-55d1-494a-b70b-2c090c4990ef req-6cb6a0f9-43fd-4ff6-8dab-e2a4633dd72c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:44.612727 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7aa74797-55d1-494a-b70b-2c090c4990ef req-6cb6a0f9-43fd-4ff6-8dab-e2a4633dd72c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0657120 Nov 18 21:01:44.696756 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7aa74797-55d1-494a-b70b-2c090c4990ef req-ea067efd-a8aa-4986-9e5f-775096038522 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0705831 Nov 18 21:01:44.956088 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-397c6f20-6680-427d-b5a8-e9e9d055017d service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.2580044 Nov 18 21:01:45.104022 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-35ff129c-96bf-48ff-9768-5102f1655600 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:45.105898 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-35ff129c-96bf-48ff-9768-5102f1655600 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d84c0234ebde42a9a24ece0729b10890&device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 1099 time: 0.0577774 Nov 18 21:01:45.303345 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-0a0fadbc-20ff-4eec-be6c-76fc56b4110b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:45.306027 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-0a0fadbc-20ff-4eec-be6c-76fc56b4110b service neutron] 10.222.0.62 "GET /v2.0/networks?id=f1ea2660-7fe2-437d-9b30-7d386db79f6c HTTP/1.1" status: 200 len: 911 time: 0.1537416 Nov 18 21:01:45.372865 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-21435697-d303-4f09-bfc1-199003ef98fc service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a HTTP/1.1" status: 200 len: 217 time: 0.0430460 Nov 18 21:01:45.460201 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-888abfb6-3a61-495f-b041-4b44f194be46 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:45.464600 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-888abfb6-3a61-495f-b041-4b44f194be46 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=39256260-0b56-47a0-a1ad-a05a1ac59638 HTTP/1.1" status: 200 len: 850 time: 0.0760498 Nov 18 21:01:45.532873 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-9d300fd6-0a1c-4d31-8e2e-e475075390b3 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=f1ea2660-7fe2-437d-9b30-7d386db79f6c&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0519440 Nov 18 21:01:45.824979 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-92a0c697-39aa-4f27-9d16-ff52a2dcdebd service neutron] 10.222.0.62 "GET /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2773886 Nov 18 21:01:45.953553 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d55fb614-0f99-4f03-bd77-384246874a57 req-630cf389-122c-4747-a594-495278d312d3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:45.956702 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d55fb614-0f99-4f03-bd77-384246874a57 req-630cf389-122c-4747-a594-495278d312d3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0991392 Nov 18 21:01:46.014303 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34342) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:46.051291 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d55fb614-0f99-4f03-bd77-384246874a57 req-6d0772b5-06be-4608-a488-6e38f4c2e777 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0817463 Nov 18 21:01:46.228602 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.352449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.358474 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.426060 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1d2bc64-f054-4406-98d0-b013652738e0,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:46.430537 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=63054f540759421d9504f9aadbb7734e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4136050 Nov 18 21:01:46.434005 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34354) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:46.437215 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.437573 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.438047 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.438396 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.438737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.439073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.439409 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.439743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.440077 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.440436 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.440765 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.441089 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-c1d737bf-c4dc-4706-beef-30286fb300ae admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.489935 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.512528 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.568100 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.572782 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:46.574061 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d1d2bc64-f054-4406-98d0-b013652738e0 HTTP/1.1" status: 204 len: 168 time: 0.1389394 Nov 18 21:01:46.584256 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1d2bc64-f054-4406-98d0-b013652738e0,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:46.593076 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.593542 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.593974 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.594376 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.594783 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.595199 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.595610 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.596071 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.596836 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.597213 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.597586 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.598083 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3ab100bc-099b-42f4-9a77-ab9867bfbd0c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:46.933587 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1089fcdb-41ff-46b5-98dd-d4517db115f4 req-1ebf1106-1106-4ae2-8ccb-af2a790fe5c8 service neutron] 10.222.0.62 "GET /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1223593 Nov 18 21:01:47.007507 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34364) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:47.021633 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f4ae669b-de1a-49e0-8dab-17bf972938b8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.134212 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f4ae669b-de1a-49e0-8dab-17bf972938b8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.144580 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f4ae669b-de1a-49e0-8dab-17bf972938b8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.208936 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4ae669b-de1a-49e0-8dab-17bf972938b8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=476d975d-8a29-4d84-8488-95bee50695a7,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:47.214093 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f4ae669b-de1a-49e0-8dab-17bf972938b8 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=8178ef2b1f6b4d13bb5b0d8c0c3a1111&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2054434 Nov 18 21:01:47.218583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34372) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:47.259157 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1c036d4-4a6b-4be4-8577-26a1eb28ce89 req-966dd116-2a54-45ab-b30e-3c7e3273be7e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:47.260623 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f1c036d4-4a6b-4be4-8577-26a1eb28ce89 req-966dd116-2a54-45ab-b30e-3c7e3273be7e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0817170 Nov 18 21:01:47.293374 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-62e1f110-b102-4e74-b6a2-5f6c5240daa5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.323520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-62e1f110-b102-4e74-b6a2-5f6c5240daa5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.343134 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f1c036d4-4a6b-4be4-8577-26a1eb28ce89 req-06b9e90e-61ae-4f4d-ab3d-030157ce7e6e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0760679 Nov 18 21:01:47.385839 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-62e1f110-b102-4e74-b6a2-5f6c5240daa5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.388678 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-62e1f110-b102-4e74-b6a2-5f6c5240daa5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:47.390985 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-62e1f110-b102-4e74-b6a2-5f6c5240daa5 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/476d975d-8a29-4d84-8488-95bee50695a7 HTTP/1.1" status: 204 len: 168 time: 0.1699371 Nov 18 21:01:47.399879 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62e1f110-b102-4e74-b6a2-5f6c5240daa5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=476d975d-8a29-4d84-8488-95bee50695a7,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:48.518548 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec7d7230-392c-4549-b548-10b22cdda9f1 req-8aa6d5c7-0eb9-4605-8402-676f3aa91925 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:48.521115 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ec7d7230-392c-4549-b548-10b22cdda9f1 req-8aa6d5c7-0eb9-4605-8402-676f3aa91925 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0655794 Nov 18 21:01:48.580132 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ec7d7230-392c-4549-b548-10b22cdda9f1 req-ea9eff8f-6942-45e1-962d-fc66f6a528ab tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528414 Nov 18 21:01:49.271822 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:49.821954 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9acc0fc-6620-4223-afee-4741ed5f75e5 req-ec2b6c8a-a7c5-4242-8330-325fd8f3f25d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:49.827552 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e9acc0fc-6620-4223-afee-4741ed5f75e5 req-ec2b6c8a-a7c5-4242-8330-325fd8f3f25d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1189857 Nov 18 21:01:49.943578 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e9acc0fc-6620-4223-afee-4741ed5f75e5 req-9400a2ae-8f65-4278-bba2-1699706ce568 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1062479 Nov 18 21:01:50.462315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34496) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:50.614730 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0bfe5851-42f1-42c6-b1f9-af9b720ef0c2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.742901 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0bfe5851-42f1-42c6-b1f9-af9b720ef0c2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.748297 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0bfe5851-42f1-42c6-b1f9-af9b720ef0c2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.800370 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0bfe5851-42f1-42c6-b1f9-af9b720ef0c2 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6e65b53796e64501bbbbd00dcc31f049&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3368680 Nov 18 21:01:50.801470 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bfe5851-42f1-42c6-b1f9-af9b720ef0c2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=022d9c15-50f1-4c9a-b649-8fa57de4cea3,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:50.804540 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34510) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:50.883551 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-137b5542-b49f-4fb1-919f-49fe068fb386 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.917179 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-137b5542-b49f-4fb1-919f-49fe068fb386 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.989873 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-137b5542-b49f-4fb1-919f-49fe068fb386 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.995357 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-137b5542-b49f-4fb1-919f-49fe068fb386 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:50.997030 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-137b5542-b49f-4fb1-919f-49fe068fb386 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/022d9c15-50f1-4c9a-b649-8fa57de4cea3 HTTP/1.1" status: 204 len: 168 time: 0.1911168 Nov 18 21:01:51.023855 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-137b5542-b49f-4fb1-919f-49fe068fb386 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=022d9c15-50f1-4c9a-b649-8fa57de4cea3,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:51.097865 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-315df6ac-c428-4efe-b838-3064526e8ab5 req-1819f23c-ffe7-4188-b588-60078e443b02 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:51.099963 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-315df6ac-c428-4efe-b838-3064526e8ab5 req-1819f23c-ffe7-4188-b588-60078e443b02 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0690033 Nov 18 21:01:51.169971 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-315df6ac-c428-4efe-b838-3064526e8ab5 req-67539dda-6369-448c-bf63-4c2be88b9ef2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0620451 Nov 18 21:01:51.387667 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34522) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:51.413064 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c90ac0ba-4be2-4cff-bc56-f987e47deb2a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.561306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c90ac0ba-4be2-4cff-bc56-f987e47deb2a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.567597 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c90ac0ba-4be2-4cff-bc56-f987e47deb2a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.637723 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c90ac0ba-4be2-4cff-bc56-f987e47deb2a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e318ad2f79154278b43a47fd6920e952&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2484164 Nov 18 21:01:51.639590 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c90ac0ba-4be2-4cff-bc56-f987e47deb2a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=af2cb57d-134a-4485-995e-86a83209f7de,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:51.640764 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34528) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:51.716751 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-66d33c56-ee2b-4926-8b6d-e7b8cf1cf404 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.756354 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-66d33c56-ee2b-4926-8b6d-e7b8cf1cf404 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.826142 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-66d33c56-ee2b-4926-8b6d-e7b8cf1cf404 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.830953 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-66d33c56-ee2b-4926-8b6d-e7b8cf1cf404 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:51.832919 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-66d33c56-ee2b-4926-8b6d-e7b8cf1cf404 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/af2cb57d-134a-4485-995e-86a83209f7de HTTP/1.1" status: 204 len: 168 time: 0.1904480 Nov 18 21:01:51.846719 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-66d33c56-ee2b-4926-8b6d-e7b8cf1cf404 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=af2cb57d-134a-4485-995e-86a83209f7de,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:52.343810 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a49a7fb7-8273-4e30-9604-b8b187f2c60a req-1d685365-26dc-444a-9c37-507b924394bc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:52.343810 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a49a7fb7-8273-4e30-9604-b8b187f2c60a req-1d685365-26dc-444a-9c37-507b924394bc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0614541 Nov 18 21:01:52.406828 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a49a7fb7-8273-4e30-9604-b8b187f2c60a req-ae1a779a-0003-4ea5-9183-47473e8e5d2b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0572507 Nov 18 21:01:52.744755 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34564) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:52.879479 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-2067749632-network', 'tenant_id': '05d2b75b4995419da5138c25c602c16e'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:52.906481 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Made reservation on behalf of 05d2b75b4995419da5138c25c602c16e for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:52.909308 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:52.920386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.024491 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.030354 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.063834 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 649} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:01:53.078712 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eb79f9a0-0320-4d56-8fdc-62bf7176a220,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:53.085676 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.086024 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Added segment b1433240-d17a-40eb-99a6-9242910e08a2 of type vlan for network d912b0f3-c291-4df9-ad87-83ebffd63dae Nov 18 21:01:53.127792 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.158303 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.159306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:53.159917 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.223824 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.4777660 Nov 18 21:01:53.227389 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34572) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:53.233672 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Request body: {'subnet': {'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-2067749632-subnet', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:53.239816 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf9de4ac-192a-46c8-982d-c1b0dbc53bd4 admin admin] Pushing event updated for resources: {'Network': ['ID=d912b0f3-c291-4df9-ad87-83ebffd63dae,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:53.255003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network d912b0f3-c291-4df9-ad87-83ebffd63dae details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:01:53.264770 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Made reservation on behalf of 05d2b75b4995419da5138c25c602c16e for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:01:53.267327 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Publish callbacks [] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.473601 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.557195 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Pushing event updated for resources: {'Subnet': ['ID=15d33670-10a1-4513-bd2b-7b0b1de2e25c,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:53.564726 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Checking segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:53.565629 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Network hostable DHCP agents. Network: d912b0f3-c291-4df9-ad87-83ebffd63dae, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:01:53.576425 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7e73d82-e1d8-41fc-bdf0-1e9d4767a678 req-400c9b17-6784-42c1-9fbb-a1802d30403d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:53.581031 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7e73d82-e1d8-41fc-bdf0-1e9d4767a678 req-400c9b17-6784-42c1-9fbb-a1802d30403d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0719969 Nov 18 21:01:53.604874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Network d912b0f3-c291-4df9-ad87-83ebffd63dae is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:01:53.626424 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, d912b0f3-c291-4df9-ad87-83ebffd63dae) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:53.639038 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:53.639831 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c931ff41-145d-4b4a-8626-974f2346f80c None None] Network d912b0f3-c291-4df9-ad87-83ebffd63dae requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:01:53.640952 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.691497 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7e73d82-e1d8-41fc-bdf0-1e9d4767a678 req-bc085a89-6794-420d-8ebf-0416a4dbd6e5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985484 Nov 18 21:01:53.693419 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9d42a07b-8f11-436e-82b8-17aef0db5b0a admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 851 time: 0.4642460 Nov 18 21:01:53.696871 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34580) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:53.709260 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:01:53.759144 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.766118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.869644 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:53.955742 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-d912b0f3-c291-4df9-ad87-83ebffd63dae', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:01:53.957448 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.107050 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.208309 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Allocated IP 172.20.0.2 (d912b0f3-c291-4df9-ad87-83ebffd63dae/15d33670-10a1-4513-bd2b-7b0b1de2e25c/58b6e060-0b25-4426-994f-8c58bfddfb0b) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:54.436303 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.465758 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.482582 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.495421 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.577019 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Network d912b0f3-c291-4df9-ad87-83ebffd63dae is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:54.580627 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:54.595375 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:54.606952 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Pushing event updated for resources: {'Port': ['ID=58b6e060-0b25-4426-994f-8c58bfddfb0b,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:54.623854 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Allocated IP 172.27.3.170 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/de07cc99-a61e-40f3-bc98-cd29b32552e7) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:54.673096 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.673692 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.674201 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.674679 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.675177 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.676318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.676318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.676318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.676781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.676980 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.677460 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.677959 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:54.695911 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Attempting to bind port 58b6e060-0b25-4426-994f-8c58bfddfb0b on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:01:54.696694 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Attempting to bind port 58b6e060-0b25-4426-994f-8c58bfddfb0b by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:01:54.697224 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Attempting to bind port 58b6e060-0b25-4426-994f-8c58bfddfb0b on network d912b0f3-c291-4df9-ad87-83ebffd63dae {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:54.705574 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 1, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:01:54.706251 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Checking segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:54.706814 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.707394 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Bound using segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:01:54.708540 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Bound port: 58b6e060-0b25-4426-994f-8c58bfddfb0b, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:01:54.709140 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.848026 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] For port 58b6e060-0b25-4426-994f-8c58bfddfb0b, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:01:54.862731 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] For port 58b6e060-0b25-4426-994f-8c58bfddfb0b, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=58b6e060-0b25-4426-994f-8c58bfddfb0b,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:01:54.871115 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.905896 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:54.927507 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d695aab-a997-49d3-97f3-0010d263b9c9 req-d4af66e6-2b66-48ae-86ce-00840ec42336 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:54.929673 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d695aab-a997-49d3-97f3-0010d263b9c9 req-d4af66e6-2b66-48ae-86ce-00840ec42336 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0860670 Nov 18 21:01:54.998814 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.040682 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548e58c6-4288-4224-b323-a05f352d41ac None None] Pushing event updated for resources: {'Port': ['ID=58b6e060-0b25-4426-994f-8c58bfddfb0b,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:55.056707 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d695aab-a997-49d3-97f3-0010d263b9c9 req-1a0cf953-b451-4447-969b-9ec3219dca8e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1170416 Nov 18 21:01:55.086196 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:55.088719 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:55.099229 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:55.200653 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34624) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:55.265997 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Pushing event updated for resources: {'Port': ['ID=de07cc99-a61e-40f3-bc98-cd29b32552e7,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:55.282257 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2a5b4cc-54cb-4b6d-a36c-66d28331a6b4 req-19f34424-acd7-4858-af0b-a75ca1762789 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:55.294505 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e2a5b4cc-54cb-4b6d-a36c-66d28331a6b4 req-19f34424-acd7-4858-af0b-a75ca1762789 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.3513153 Nov 18 21:01:55.319104 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34636) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:55.391635 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e2a5b4cc-54cb-4b6d-a36c-66d28331a6b4 req-0e8339ce-bc2a-449d-a6dc-e8d697e76dfc tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0955930 Nov 18 21:01:55.396079 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Deleting subnet 98cabe4f-101c-4479-9ab8-6bb088ca3426 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:01:55.415196 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.518341 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e99cbe7-bd12-47de-8abd-4850ed2992c3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.567128 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.592824 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.635916 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.722425 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.780159 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=98cabe4f-101c-4479-9ab8-6bb088ca3426,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:55.794381 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.800806 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-5767f4c6-daec-433b-80f6-5b66619a5ef1 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/98cabe4f-101c-4479-9ab8-6bb088ca3426 HTTP/1.1" status: 204 len: 168 time: 0.4796612 Nov 18 21:01:55.812688 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34654) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:55.843667 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e99cbe7-bd12-47de-8abd-4850ed2992c3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.867703 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e99cbe7-bd12-47de-8abd-4850ed2992c3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:55.978222 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6e99cbe7-bd12-47de-8abd-4850ed2992c3 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a19e331a40f749bc950f68792b2e41a7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7763600 Nov 18 21:01:55.992940 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34664) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:56.008940 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.044888 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e99cbe7-bd12-47de-8abd-4850ed2992c3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fe68ddc3-1aa9-4bbd-a69e-a057c3d53606,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:56.095090 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.215770 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0af93b8c-4222-41a8-a0a7-ad6714a811fb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.330274 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0af93b8c-4222-41a8-a0a7-ad6714a811fb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.335615 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.351460 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db8aeee-d209-4d42-ae74-7047be2c380e req-3bb5d525-5aff-4a46-979f-0c34420802b4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:56.354640 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7db8aeee-d209-4d42-ae74-7047be2c380e req-3bb5d525-5aff-4a46-979f-0c34420802b4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1807463 Nov 18 21:01:56.371398 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Router 95e57f35-7985-470a-b802-3cb4e75797cd is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102669) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:01:56.413531 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.414117 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.415420 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.420814 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > port after_create 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.421723 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > port after_delete 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.423092 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > port after_update 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.424223 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.425955 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.426746 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.427533 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.439577 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 58b6e060-0b25-4426-994f-8c58bfddfb0b up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:56.519014 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7db8aeee-d209-4d42-ae74-7047be2c380e req-e5e6e292-4447-431e-9f4d-4b06eb01a3fe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521449 Nov 18 21:01:56.583450 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 58b6e060-0b25-4426-994f-8c58bfddfb0b triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:56.584174 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.621636 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:01:56.636646 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Sync routers for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:01:56.648550 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.653115 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1a1c1b1d-0578-4f2c-afcd-f66c1abee245 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 927 time: 2.9531810 Nov 18 21:01:56.657593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34678) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:56.661133 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:01:56.662158 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:01:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:56.693216 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.693614 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.694037 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.694896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102670) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:01:56.695282 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['7acc544e-e22e-4612-9a9e-a730bb0c4847']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:56.734771 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.790290 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2b67f587-ae65-48d1-8eda-f85b04a9a47a') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:56.791455 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2b67f587-ae65-48d1-8eda-f85b04a9a47a') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:56.796449 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:01:56.827451 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 58b6e060-0b25-4426-994f-8c58bfddfb0b, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=58b6e060-0b25-4426-994f-8c58bfddfb0b,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:56.852725 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.860866 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.873925 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9164b1d-6953-4789-a1b5-2ceefac8387f None None] Network d912b0f3-c291-4df9-ad87-83ebffd63dae requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:01:56.908634 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:56.949064 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88c10f8e-c429-40f0-84e3-8f3cc85fda4a req-6b3a12d6-58eb-40af-8597-42c70dd98463 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:56.967024 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88c10f8e-c429-40f0-84e3-8f3cc85fda4a req-6b3a12d6-58eb-40af-8597-42c70dd98463 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.2569427 Nov 18 21:01:57.001230 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Releasing vlan 629 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:01:57.002248 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: from cryptography.utils import int_from_bytes Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: from cryptography.utils import int_from_bytes Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:01:57.054339 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:01:57.078336 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-4a57d9ce-dd33-4d3e-bfd2-b2a91bc91f68 None None] Provisioning complete for port 58b6e060-0b25-4426-994f-8c58bfddfb0b triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:57.078908 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-4a57d9ce-dd33-4d3e-bfd2-b2a91bc91f68 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.136724 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=58b6e060-0b25-4426-994f-8c58bfddfb0b,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:57.136936 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0af93b8c-4222-41a8-a0a7-ad6714a811fb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.137839 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:55Z', 'revision_number': 3, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:01:54Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:57.142937 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0af93b8c-4222-41a8-a0a7-ad6714a811fb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.143733 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0af93b8c-4222-41a8-a0a7-ad6714a811fb admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/fe68ddc3-1aa9-4bbd-a69e-a057c3d53606 HTTP/1.1" status: 204 len: 168 time: 1.1452816 Nov 18 21:01:57.144966 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.191483 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0af93b8c-4222-41a8-a0a7-ad6714a811fb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fe68ddc3-1aa9-4bbd-a69e-a057c3d53606,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:57.199582 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Checking router: 95e57f35-7985-470a-b802-3cb4e75797cd for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:01:57.200154 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Updating router 95e57f35-7985-470a-b802-3cb4e75797cd port de07cc99-a61e-40f3-bc98-cd29b32552e7 binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:01:57.230628 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.236545 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] 10.222.0.61 "DELETE /v2.0/networks/7acc544e-e22e-4612-9a9e-a730bb0c4847 HTTP/1.1" status: 204 len: 168 time: 1.4218979 Nov 18 21:01:57.286210 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34686) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:57.299145 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.308126 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88c10f8e-c429-40f0-84e3-8f3cc85fda4a req-dd2754ca-af6b-429c-a05e-44a73d0b90c7 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3348727 Nov 18 21:01:57.309825 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7d3af17-c15a-4cec-8f9c-c457fe881d13 admin admin] Pushing event deleted for resources: {'Network': ['ID=7acc544e-e22e-4612-9a9e-a730bb0c4847,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:57.458351 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Deleting subnet 67bbc66e-8711-42f8-bf2c-d7ce12103373 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:01:57.464346 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.538953 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.682064 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.844843 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.854935 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34698) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:57.897590 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=67bbc66e-8711-42f8-bf2c-d7ce12103373,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:57.901633 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-57aef072-f36a-4684-8602-c76866c45ce2 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.907631 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:57.914959 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c848cd9a-86ac-46a3-b934-acf1294e462e admin admin] 10.222.0.61 "DELETE /v2.0/subnets/67bbc66e-8711-42f8-bf2c-d7ce12103373 HTTP/1.1" status: 204 len: 168 time: 0.5967767 Nov 18 21:01:57.915844 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34700) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:57.947778 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-898b650a-08ee-4825-ae52-6f92e6f7d562 req-d99dbd1c-dc75-425a-947c-15a072fe4e53 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:57.950567 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-898b650a-08ee-4825-ae52-6f92e6f7d562 req-d99dbd1c-dc75-425a-947c-15a072fe4e53 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1601532 Nov 18 21:01:58.019143 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.030119 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.041868 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.086092 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-898b650a-08ee-4825-ae52-6f92e6f7d562 req-cf14f736-1089-4fd8-b1cb-c14234683df3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1263635 Nov 18 21:01:58.161119 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Pushing event updated for resources: {'Port': ['ID=de07cc99-a61e-40f3-bc98-cd29b32552e7,revision_number=2']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:58.170995 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Attempting to bind port de07cc99-a61e-40f3-bc98-cd29b32552e7 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:01:58.171749 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Attempting to bind port de07cc99-a61e-40f3-bc98-cd29b32552e7 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:01:58.172313 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Attempting to bind port de07cc99-a61e-40f3-bc98-cd29b32552e7 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:01:58.179803 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.180490 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.180611 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.180878 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.181211 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.181693 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.182029 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.182362 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.182713 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.183044 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.183367 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.183691 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:01:58.203849 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-888d295b-5bc4-4bf5-b0d3-9e9adfee9faf None None] Provisioning complete for port 58b6e060-0b25-4426-994f-8c58bfddfb0b triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:58.204447 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-888d295b-5bc4-4bf5-b0d3-9e9adfee9faf None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.205653 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.215948 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 1, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:01:58.216373 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:01:58.216790 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.217200 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:01:58.217712 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Bound port: de07cc99-a61e-40f3-bc98-cd29b32552e7, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:01:58.218159 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.299012 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.341681 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] For port de07cc99-a61e-40f3-bc98-cd29b32552e7, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:01:58.348185 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] For port de07cc99-a61e-40f3-bc98-cd29b32552e7, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=de07cc99-a61e-40f3-bc98-cd29b32552e7,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:01:58.351533 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['a243042a-74f9-4ab9-8244-32fa08c301a4']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:58.353005 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 58b6e060-0b25-4426-994f-8c58bfddfb0b up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:01:58.364295 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.398982 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9bdbd408-d7a8-4c1f-a2a2-775ff23bede4') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:58.399398 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9bdbd408-d7a8-4c1f-a2a2-775ff23bede4') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:58.435596 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-57aef072-f36a-4684-8602-c76866c45ce2 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.440135 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 58b6e060-0b25-4426-994f-8c58bfddfb0b triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:58.440530 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:01:58.441455 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:01:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:58.442255 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.445120 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.460201 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-57aef072-f36a-4684-8602-c76866c45ce2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.506120 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-57aef072-f36a-4684-8602-c76866c45ce2 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3ec2b6defd244a7982d21ea9b0771d81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6490173 Nov 18 21:01:58.506791 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34710) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:58.623740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Allocated IP 172.20.0.1 (d912b0f3-c291-4df9-ad87-83ebffd63dae/15d33670-10a1-4513-bd2b-7b0b1de2e25c/a615f218-b382-4149-860b-310ec91bd3fe) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:01:58.642392 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.654372 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:01:58.674777 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-525a7b60-a144-4035-925b-04991bf4c250 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.680315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Releasing vlan 618 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:01:58.680723 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:01:58.682586 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:01:58.686262 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57aef072-f36a-4684-8602-c76866c45ce2 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ba4e38f1-f3dc-42b7-8e7c-6563383c003c,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:58.747757 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00428f8b-5ac4-40f5-afc0-d190eb267a25 req-bc021f6a-f3fd-45b1-94d4-cb877bca4bb5 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:58.750578 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00428f8b-5ac4-40f5-afc0-d190eb267a25 req-bc021f6a-f3fd-45b1-94d4-cb877bca4bb5 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.2872040 Nov 18 21:01:58.771973 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-20c36f1b-ca9d-4257-8d78-13bfff66db4f tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:01:58.774604 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-20c36f1b-ca9d-4257-8d78-13bfff66db4f tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.62 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 946 time: 0.1684799 Nov 18 21:01:58.777544 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-525a7b60-a144-4035-925b-04991bf4c250 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.789851 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.816805 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.820625 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] 10.222.0.61 "DELETE /v2.0/networks/a243042a-74f9-4ab9-8244-32fa08c301a4 HTTP/1.1" status: 204 len: 168 time: 0.9011476 Nov 18 21:01:58.855869 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d6c6bdc-d538-46d6-9100-4c049509e36e None None] Pushing event updated for resources: {'Port': ['ID=de07cc99-a61e-40f3-bc98-cd29b32552e7,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:58.900160 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00428f8b-5ac4-40f5-afc0-d190eb267a25 req-c3cfb9fd-462a-40e7-a2ec-9d0b2ff19488 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1369092 Nov 18 21:01:58.953968 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:58.960978 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-906d4957-4016-4e28-b50a-cc707a2822df admin admin] Pushing event deleted for resources: {'Network': ['ID=a243042a-74f9-4ab9-8244-32fa08c301a4,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:59.044911 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.086461 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-525a7b60-a144-4035-925b-04991bf4c250 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.089895 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-525a7b60-a144-4035-925b-04991bf4c250 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.091914 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-525a7b60-a144-4035-925b-04991bf4c250 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/ba4e38f1-f3dc-42b7-8e7c-6563383c003c HTTP/1.1" status: 204 len: 168 time: 0.5794947 Nov 18 21:01:59.111264 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-525a7b60-a144-4035-925b-04991bf4c250 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ba4e38f1-f3dc-42b7-8e7c-6563383c003c,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:59.112555 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:55Z', 'revision_number': 3, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:01:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:01:59.136516 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Pushing event updated for resources: {'Port': ['ID=a615f218-b382-4149-860b-310ec91bd3fe,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:01:59.157475 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Network d912b0f3-c291-4df9-ad87-83ebffd63dae is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:01:59.159939 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:01:59.163577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:01:59.164583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.194984 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Deleting port 3d1065d4-abc3-48ca-9275-5c415cb3466a {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:01:59.197610 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.313765 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d444288d-ccec-427d-be8c-d40834bd615d None None] The sync data for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi is: [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:55Z', 'revision_number': 3, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:01:58Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:01:59.371023 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34726) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:59.504927 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] For port 3d1065d4-abc3-48ca-9275-5c415cb3466a, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3d1065d4-abc3-48ca-9275-5c415cb3466a,segment=NetworkSegment(1822c8a3-e235-4644-8a58-074d8932baed),segment_id=1822c8a3-e235-4644-8a58-074d8932baed)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:01:59.505619 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.506197 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-0e8c2698-3b6f-49b8-9bf0-ad5ff442333b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d9611baddf3943198c1937bb0b65f000&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1337068 Nov 18 21:01:59.511685 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34730) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:01:59.516806 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.585776 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Calling delete_port for 3d1065d4-abc3-48ca-9275-5c415cb3466a owned by compute:nova {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:01:59.656154 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-62d832af-5cb0-4abe-becf-c1477f5dbfe0 None None] Provisioning complete for port a615f218-b382-4149-860b-310ec91bd3fe triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:01:59.656913 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-62d832af-5cb0-4abe-becf-c1477f5dbfe0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.713524 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-62d832af-5cb0-4abe-becf-c1477f5dbfe0 None None] Port a615f218-b382-4149-860b-310ec91bd3fe cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:01:59.846733 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44963a66-9eb7-407b-bd4d-b83ea6824d80 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.962481 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.978401 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:01:59.979879 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.003786 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5620d8ed-26c0-4724-b87d-f0ce913ee887 req-4fa4b107-8187-4e20-87af-7d23cd36ec47 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:00.005806 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5620d8ed-26c0-4724-b87d-f0ce913ee887 req-4fa4b107-8187-4e20-87af-7d23cd36ec47 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.5777848 Nov 18 21:02:00.075831 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44963a66-9eb7-407b-bd4d-b83ea6824d80 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.196676 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5620d8ed-26c0-4724-b87d-f0ce913ee887 req-4bf49c56-f81a-4555-a4b0-a95702b4eb8f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1683168 Nov 18 21:02:00.310520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Pushing event updated for resources: {'Port': ['ID=a615f218-b382-4149-860b-310ec91bd3fe,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:00.311596 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.328381 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['3d1065d4-abc3-48ca-9275-5c415cb3466a'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:02:00.369284 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Pushing event deleted for resources: {'Port': ['ID=3d1065d4-abc3-48ca-9275-5c415cb3466a,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:00.442743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29fe4483-8ae4-41de-9be1-a29d12b36fbd req-b45715c8-1748-4840-b247-20a0e9e7026d tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:00.455492 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-29fe4483-8ae4-41de-9be1-a29d12b36fbd req-b45715c8-1748-4840-b247-20a0e9e7026d tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 867 time: 0.3522496 Nov 18 21:02:00.527397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Network d912b0f3-c291-4df9-ad87-83ebffd63dae is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:00.532150 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44963a66-9eb7-407b-bd4d-b83ea6824d80 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.534766 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] No DVR routers for this DVR port 3d1065d4-abc3-48ca-9275-5c415cb3466a on host hv-cinder-79987 {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:02:00.540228 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44963a66-9eb7-407b-bd4d-b83ea6824d80 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.543272 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-44963a66-9eb7-407b-bd4d-b83ea6824d80 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/4fcb1a46-94f6-4589-9cb0-64ceca8e5cc3 HTTP/1.1" status: 204 len: 168 time: 1.0300493 Nov 18 21:02:00.552992 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:00.554911 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.558946 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device de07cc99-a61e-40f3-bc98-cd29b32552e7 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:00.560874 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ed945015-be70-4af9-9cd7-d5fc5bfeffb4 req-67b0ed9d-8a21-4b22-91b3-97b84c7c998c tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.62 "DELETE /v2.0/ports/3d1065d4-abc3-48ca-9275-5c415cb3466a HTTP/1.1" status: 204 len: 173 time: 1.7724319 Nov 18 21:02:00.561368 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'name': 'network-vif-deleted', 'tag': '3d1065d4-abc3-48ca-9275-5c415cb3466a'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:02:00.565077 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-409e57aa-43f7-4cf1-affd-11ec3106ed14" -d '{"events": [{"server_uuid": "b957f670-6b5a-4acf-883d-2111d15606e6", "name": "network-vif-deleted", "tag": "3d1065d4-abc3-48ca-9275-5c415cb3466a"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:02:00.614449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44963a66-9eb7-407b-bd4d-b83ea6824d80 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4fcb1a46-94f6-4589-9cb0-64ceca8e5cc3,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:00.686440 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:02:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c6670d04-e309-4c6c-afc2-56dc2469e7b9 x-openstack-request-id: req-c6670d04-e309-4c6c-afc2-56dc2469e7b9 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:02:00.686887 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b957f670-6b5a-4acf-883d-2111d15606e6", "name": "network-vif-deleted", "tag": "3d1065d4-abc3-48ca-9275-5c415cb3466a", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:02:00.687316 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c6670d04-e309-4c6c-afc2-56dc2469e7b9 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:02:00.687935 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b957f670-6b5a-4acf-883d-2111d15606e6', 'name': 'network-vif-deleted', 'tag': '3d1065d4-abc3-48ca-9275-5c415cb3466a', 'status': 'completed', 'code': 200} Nov 18 21:02:00.837783 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port de07cc99-a61e-40f3-bc98-cd29b32552e7 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:00.838787 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:00.860023 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-29fe4483-8ae4-41de-9be1-a29d12b36fbd req-bfbd8ff7-2661-4b21-b4ec-2c6f8b2f4cf0 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/security-groups?id=c187060e-d2ce-4a0f-a084-e32892be1597&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4031670 Nov 18 21:02:01.020005 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Router 95e57f35-7985-470a-b802-3cb4e75797cd has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:02:01.052192 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.131530 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-3aaa9fb5-b7f2-4542-ad92-6b355c8e782f None None] Provisioning complete for port a615f218-b382-4149-860b-310ec91bd3fe triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:01.132932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-3aaa9fb5-b7f2-4542-ad92-6b355c8e782f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.142957 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port de07cc99-a61e-40f3-bc98-cd29b32552e7, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=de07cc99-a61e-40f3-bc98-cd29b32552e7,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:01.191778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.235674 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:01.265479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8b67311d-72aa-4845-96a3-a241b9dec8e1 admin admin] 10.222.0.61 "PUT /v2.0/routers/95e57f35-7985-470a-b802-3cb4e75797cd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 4.6063237 Nov 18 21:02:01.357974 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-3aaa9fb5-b7f2-4542-ad92-6b355c8e782f None None] Port a615f218-b382-4149-860b-310ec91bd3fe cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:01.368674 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=de07cc99-a61e-40f3-bc98-cd29b32552e7,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:01.432520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-626a64e1-ca21-4b04-aa18-3824dda48208 req-101e1be2-3cd9-402c-b874-c898e3c900f4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:01.434611 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-626a64e1-ca21-4b04-aa18-3824dda48208 req-101e1be2-3cd9-402c-b874-c898e3c900f4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0989659 Nov 18 21:02:01.539976 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-626a64e1-ca21-4b04-aa18-3824dda48208 req-313474ba-e901-47ff-9b48-164a4cf91fbb tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989561 Nov 18 21:02:01.663931 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34786) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:01.718025 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-4e69b5fd-5ef7-4512-8b41-28df146a7538 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d41878b5642f44c8a28b650414407a81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0524075 Nov 18 21:02:01.721939 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34788) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:01.789491 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f1f7b104-b077-42bd-afb4-4cb595ad6b99 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.836395 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f1f7b104-b077-42bd-afb4-4cb595ad6b99 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.874132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34794) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:01.937059 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f1f7b104-b077-42bd-afb4-4cb595ad6b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.943910 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f1f7b104-b077-42bd-afb4-4cb595ad6b99 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:01.946316 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f1f7b104-b077-42bd-afb4-4cb595ad6b99 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8df947f7-1f54-4ab4-ac88-f268b4ccc0f6 HTTP/1.1" status: 204 len: 168 time: 0.2226551 Nov 18 21:02:01.961949 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1f7b104-b077-42bd-afb4-4cb595ad6b99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8df947f7-1f54-4ab4-ac88-f268b4ccc0f6,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:02.127145 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9c8f4a0d-a349-4d19-a871-1ba03e281086 req-f0e9e2a2-28ad-4e4a-973a-45312e230b67 tempest-DeleteServersTestJSON-233841276 tempest-DeleteServersTestJSON-233841276-project] 10.222.0.61 "GET /v2.0/ports?device_id=b957f670-6b5a-4acf-883d-2111d15606e6 HTTP/1.1" status: 200 len: 210 time: 0.0608597 Nov 18 21:02:02.211431 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-42a2be9b-7095-4775-9c97-6095638ec0ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:02.300805 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3d1065d4-abc3-48ca-9275-5c415cb3466a no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:02:02.358743 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 3d1065d4-abc3-48ca-9275-5c415cb3466a {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:02:02.359095 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3d1065d4-abc3-48ca-9275-5c415cb3466a not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:02:02.389085 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device de07cc99-a61e-40f3-bc98-cd29b32552e7 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:02.473431 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port de07cc99-a61e-40f3-bc98-cd29b32552e7 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:02.473805 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:02.474549 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-aa230f2b-bb96-473c-a824-e4378e1ece51 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:02.477638 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-aa230f2b-bb96-473c-a824-e4378e1ece51 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.1906898 Nov 18 21:02:02.490569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e4e7039-fca4-4b82-86ff-87d77b25ccbb admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:02.507155 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Sync routers for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:02.509291 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-dddce7d9-eaf0-4578-95b1-127fb466acd8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/quotas/05431e285025437d8783475290b4e4fc HTTP/1.1" status: 200 len: 375 time: 0.0204964 Nov 18 21:02:02.539701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:02.540369 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:01:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:02.609457 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-e1eb0997-d288-4f51-9573-07683cdb9b58 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0913825 Nov 18 21:02:02.715377 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e4e7039-fca4-4b82-86ff-87d77b25ccbb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:02.777510 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9e4e7039-fca4-4b82-86ff-87d77b25ccbb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:02.801533 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-2b0c5dd3-4ff9-4b05-8e27-8a99e430bd50 service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1795113 Nov 18 21:02:02.811558 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:02.822286 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9e4e7039-fca4-4b82-86ff-87d77b25ccbb admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c378dc8c0f7945b1930cfa83a6162858&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9456615 Nov 18 21:02:02.847413 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34828) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:02.979654 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9b1a5d3-3d5f-48ba-bf17-883bac928fe2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:02.992726 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-e4eac90a-8260-4e04-a30e-6380d6db05c2 service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1851764 Nov 18 21:02:03.026643 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9b1a5d3-3d5f-48ba-bf17-883bac928fe2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:03.093270 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e4e7039-fca4-4b82-86ff-87d77b25ccbb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3e5d9315-bb3b-434f-b079-93ffa15aa6b6,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:03.106192 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c988cafb-a961-4d97-8098-cb8b69883155 req-176ac435-a272-497e-b886-4899be620ff1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:03.113793 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c988cafb-a961-4d97-8098-cb8b69883155 req-176ac435-a272-497e-b886-4899be620ff1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.3963673 Nov 18 21:02:03.154209 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9b1a5d3-3d5f-48ba-bf17-883bac928fe2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:03.159045 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f9b1a5d3-3d5f-48ba-bf17-883bac928fe2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:03.165714 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f9b1a5d3-3d5f-48ba-bf17-883bac928fe2 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3e5d9315-bb3b-434f-b079-93ffa15aa6b6 HTTP/1.1" status: 204 len: 168 time: 0.3171813 Nov 18 21:02:03.224579 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 2, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:03.245624 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f9b1a5d3-3d5f-48ba-bf17-883bac928fe2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3e5d9315-bb3b-434f-b079-93ffa15aa6b6,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:03.269463 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c988cafb-a961-4d97-8098-cb8b69883155 req-ce80d69e-a0b7-46d5-aeb9-1faf86ac6865 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1543300 Nov 18 21:02:03.315175 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Checking router: 95e57f35-7985-470a-b802-3cb4e75797cd for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:03.315792 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Updating router 95e57f35-7985-470a-b802-3cb4e75797cd port a615f218-b382-4149-860b-310ec91bd3fe binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:03.366077 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:03.572132 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fb007c8f-cefd-43ae-975e-c94e54bcc643 req-33417e40-619a-478a-b175-3a16f82bc07f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 210 time: 0.0985596 Nov 18 21:02:03.900657 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34878) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:03.909453 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-901485964-network', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:03.986628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Made reservation on behalf of a1491cc22c2d41ed8ac6b75c43e3ccc1 for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:03.988134 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:03.991757 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:03.997731 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.032187 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.120645 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3523be86-7ce7-4fbb-91ed-2742cf77107a None None] Pushing event updated for resources: {'Port': ['ID=a615f218-b382-4149-860b-310ec91bd3fe,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:04.179289 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.230333 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.274550 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 618} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:02:04.283827 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Attempting to bind port a615f218-b382-4149-860b-310ec91bd3fe on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:04.283827 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Attempting to bind port a615f218-b382-4149-860b-310ec91bd3fe by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:04.285004 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Attempting to bind port a615f218-b382-4149-860b-310ec91bd3fe on network d912b0f3-c291-4df9-ad87-83ebffd63dae {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:04.302594 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 1, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:04.303019 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Checking segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:04.303828 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.304158 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Bound using segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:04.305297 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Bound port: a615f218-b382-4149-860b-310ec91bd3fe, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:04.305693 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.385034 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.385479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Added segment ad897c02-8041-447c-b198-6ec5aa961ad2 of type vlan for network 45e03d28-5c3b-481b-81f0-d332c4379a09 Nov 18 21:02:04.453180 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] For port a615f218-b382-4149-860b-310ec91bd3fe, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:04.462866 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] For port a615f218-b382-4149-860b-310ec91bd3fe, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=a615f218-b382-4149-860b-310ec91bd3fe,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:04.469755 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.543797 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1b681cc3-67e3-4580-9315-909410c4fb5f,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:04.601971 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.678010 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c6160fb8-f202-46f3-8c56-f1ae5232fc6f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.682909 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:04.683965 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:01:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:04.687112 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3523be86-7ce7-4fbb-91ed-2742cf77107a None None] Pushing event updated for resources: {'Port': ['ID=a615f218-b382-4149-860b-310ec91bd3fe,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:04.714795 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0611703-83e9-49ea-b064-bd465b077a96 req-ac4d8d62-0d4a-449f-87b0-905656582bde tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:04.727415 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0611703-83e9-49ea-b064-bd465b077a96 req-ac4d8d62-0d4a-449f-87b0-905656582bde tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2771518 Nov 18 21:02:04.734934 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.db.resource_extend [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 21:02:04.861379 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.863010 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:04.863990 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:04.937229 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-946b1840-3022-45ce-8230-e982696bb909 None None] Provisioning complete for port a615f218-b382-4149-860b-310ec91bd3fe triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:04.944880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-946b1840-3022-45ce-8230-e982696bb909 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.056449 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-070b67b3-f8ad-4805-af8b-7804e70d0292 req-30631132-5580-4c2e-b683-4c03d5d31faf tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 210 time: 0.1254718 Nov 18 21:02:05.141513 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0611703-83e9-49ea-b064-bd465b077a96 req-137ff492-4c53-4b63-832e-a3bcb0aa5334 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3620081 Nov 18 21:02:05.153234 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 1.2504046 Nov 18 21:02:05.156673 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34916) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:05.166005 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Request body: {'subnet': {'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-901485964-subnet', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:05.185737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-67ff1daa-8887-42ed-a27a-6282a88a5a7c admin admin] Pushing event updated for resources: {'Network': ['ID=45e03d28-5c3b-481b-81f0-d332c4379a09,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:05.238093 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34920) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:05.252605 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Made reservation on behalf of a1491cc22c2d41ed8ac6b75c43e3ccc1 for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:05.255181 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6003637'] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.346553 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:02:05.429341 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-946b1840-3022-45ce-8230-e982696bb909 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.469092 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:05.522822 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Deleting subnet 39256260-0b56-47a0-a1ad-a05a1ac59638 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:02:05.534276 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.548242 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-946b1840-3022-45ce-8230-e982696bb909 None None] For port a615f218-b382-4149-860b-310ec91bd3fe, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=a615f218-b382-4149-860b-310ec91bd3fe,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:05.565536 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-946b1840-3022-45ce-8230-e982696bb909 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.654632 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.717846 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-8829912a-31ef-4505-9823-867d61226bbc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:05.719503 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-8829912a-31ef-4505-9823-867d61226bbc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.4356546 Nov 18 21:02:05.768638 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:02:05.796316 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Request body: {'port': {'device_id': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'admin_state_up': True, 'tenant_id': '05431e285025437d8783475290b4e4fc'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:05.855157 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.865342 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-275b069b-9240-43ee-be12-d9c59391a730 None None] Provisioning complete for port a615f218-b382-4149-860b-310ec91bd3fe triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:05.866809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-275b069b-9240-43ee-be12-d9c59391a730 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:05.920809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-946b1840-3022-45ce-8230-e982696bb909 None None] Pushing event updated for resources: {'Port': ['ID=a615f218-b382-4149-860b-310ec91bd3fe,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:06.161266 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5840016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6003623'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.212589 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.256683 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Made reservation on behalf of 05431e285025437d8783475290b4e4fc for: {'port': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:06.265315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.278701 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34950) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:06.335698 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.348962 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:04Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:06.463944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-41ac5019-7cb4-4f7a-9b69-d4a36f169288 None None] The sync data for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi is: [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:04Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:06.501571 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34958) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:06.502942 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=07eef04b-f3f6-4ee0-b23d-7f9f86f27c94,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:06.518387 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-40e7045b-368b-4412-81cd-7f0f497ca58f req-ef266c07-38eb-468c-9b75-97ef7d4deeaa tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 210 time: 0.1916280 Nov 18 21:02:06.535969 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.545513 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] 10.222.0.61 "DELETE /v2.0/subnets/39256260-0b56-47a0-a1ad-a05a1ac59638 HTTP/1.1" status: 204 len: 168 time: 1.3062067 Nov 18 21:02:06.561840 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83da27af-b5ff-4f0c-8ce5-9df2182c17c2 req-3a797c39-38e5-4673-aaab-43355e74bbe7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:06.585451 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83da27af-b5ff-4f0c-8ce5-9df2182c17c2 req-3a797c39-38e5-4673-aaab-43355e74bbe7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2507350 Nov 18 21:02:06.594191 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34960) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:06.649330 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed005d8a-ab33-4eb9-b3fd-b7f0791da8ee admin admin] Pushing event deleted for resources: {'Subnet': ['ID=39256260-0b56-47a0-a1ad-a05a1ac59638,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:06.652274 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Checking segment: {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:06.652274 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Network hostable DHCP agents. Network: 45e03d28-5c3b-481b-81f0-d332c4379a09, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:02:06.663830 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1335391601-network', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:06.695176 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:02:06.727959 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 45e03d28-5c3b-481b-81f0-d332c4379a09) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:06.738201 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3382d283-9220-4c39-b366-19d567830755 None None] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:06.747973 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:06.748698 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.786243 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Allocated IP 172.20.0.3 (2d6a6844-15e6-4a14-9103-24e890fa190f/fcebaf13-b181-404f-a8e5-52ddbe0c8c7c/76221db7-7a26-4eba-b39a-1b8a36a04f16) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:06.833908 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b32eb5e3-a99e-4a35-a27d-09128556ea0b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.847548 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.862761 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-8c66fade-b965-42e8-8c38-e34845ba7ca4 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 1.7009249 Nov 18 21:02:06.866503 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34964) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:06.879918 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:06.888558 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Made reservation on behalf of d0f1cb43ab064a5388db98bf6b8228fa for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:06.891635 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:06.934560 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.016203 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83da27af-b5ff-4f0c-8ce5-9df2182c17c2 req-07947507-1f28-4526-8015-8aa957a21b25 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4293919 Nov 18 21:02:07.067642 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-45e03d28-5c3b-481b-81f0-d332c4379a09', 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'fixed_ips': [{'subnet_id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:02:07.068550 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.090492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.092342 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.213335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.259496 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.269703 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.277209 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > segment before_delete 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.279011 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.279922 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.280235 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > port after_create 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.280557 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > port after_delete 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.280895 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > port after_update 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.281235 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > segment after_delete 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.281561 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.282331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.282957 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet after_update 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.311411 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Allocated IP 172.20.0.2 (45e03d28-5c3b-481b-81f0-d332c4379a09/07eef04b-f3f6-4ee0-b23d-7f9f86f27c94/5953e204-5211-4d54-80a6-f7d2b566b9be) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:07.359974 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet after_create 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.360539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.360975 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet before_create 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.361418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Subscribe: > subnet before_update 55550000 {{(pid=102669) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 18 21:02:07.361896 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['f1ea2660-7fe2-437d-9b30-7d386db79f6c']}} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:07.398437 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b32eb5e3-a99e-4a35-a27d-09128556ea0b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.431568 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '1822c8a3-e235-4644-8a58-074d8932baed') {'for_net_delete': True} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:07.431972 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '1822c8a3-e235-4644-8a58-074d8932baed') {} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:07.449625 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b32eb5e3-a99e-4a35-a27d-09128556ea0b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.480704 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.489829 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5774120'] for segment, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.578085 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.619990 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.622235 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.637123 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.637292 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.649137 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b32eb5e3-a99e-4a35-a27d-09128556ea0b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=2cc99153a15f4063956a14fd97d1277a&name=default HTTP/1.1" status: 200 len: 2996 time: 1.0604136 Nov 18 21:02:07.650284 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.651293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.654673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34974) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:07.680153 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Releasing vlan 622 on physical network physnet1 to pool {{(pid=102669) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:02:07.680812 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5320355'] for segment, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:07.692678 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:07.701008 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:07.711687 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:07.724086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: from cryptography.utils import int_from_bytes Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: from cryptography.utils import int_from_bytes Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: Traceback (most recent call last): Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: timer() Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: cb(*args, **kw) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: return func(*args, **kwargs) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: self._notify() Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: self.callback(batched_events) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: event.method(event) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: return f(self, *a, **k) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._get(url).json() Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: return self.request(url, 'GET', **kwargs) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:02:07.745584 dv-cinder-799871-8-iscsi neutron-server[102669]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:02:07.749891 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32eb5e3-a99e-4a35-a27d-09128556ea0b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b9e9003b-ffdf-46e7-a862-8f8db81ea525,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:07.874971 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Network 2d6a6844-15e6-4a14-9103-24e890fa190f is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:07.879213 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:07.889582 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:07.901915 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 637} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:02:07.936978 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event updated for resources: {'Port': ['ID=76221db7-7a26-4eba-b39a-1b8a36a04f16,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:07.980510 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Attempting to bind port 5953e204-5211-4d54-80a6-f7d2b566b9be on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:07.981131 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Attempting to bind port 5953e204-5211-4d54-80a6-f7d2b566b9be by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:07.981721 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Attempting to bind port 5953e204-5211-4d54-80a6-f7d2b566b9be on network 45e03d28-5c3b-481b-81f0-d332c4379a09 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:07.995116 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:07.996607 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.000197 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 1, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:08.002335 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Checking segment: {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:08.004228 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.004682 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Bound using segment: {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:08.005212 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Bound port: 5953e204-5211-4d54-80a6-f7d2b566b9be, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:08.005668 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.006308 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Added segment bf2c2c71-75a6-42ae-975a-74838c37b243 of type vlan for network 95263b3e-fd72-450c-984a-4cc58b6e2e30 Nov 18 21:02:08.009329 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.012408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d02163e-a02d-4546-ac53-2ec348989f18,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:08.015265 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.040076 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b62a1e8f-e8ff-48c9-9798-639084a2327d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2961247 Nov 18 21:02:08.069190 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d84d6902-14ab-4436-8b89-706e601bab1c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.073308 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.079890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] 10.222.0.61 "DELETE /v2.0/networks/f1ea2660-7fe2-437d-9b30-7d386db79f6c HTTP/1.1" status: 204 len: 168 time: 1.4832799 Nov 18 21:02:08.093665 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Request body: {'port': {'device_id': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:08.154705 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07fd0b66-0b76-40be-8660-3a7af2e3989c admin admin] Pushing event deleted for resources: {'Network': ['ID=f1ea2660-7fe2-437d-9b30-7d386db79f6c,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:08.181467 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Pushing event updated for resources: {'Port': ['ID=5953e204-5211-4d54-80a6-f7d2b566b9be,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:08.256860 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48680288-2901-4da7-a447-59a1b7f4546d req-ddc0df6a-7688-40cf-b72a-11007d21a67c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:08.277426 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48680288-2901-4da7-a447-59a1b7f4546d req-ddc0df6a-7688-40cf-b72a-11007d21a67c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 931 time: 0.4271083 Nov 18 21:02:08.283176 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] For port 5953e204-5211-4d54-80a6-f7d2b566b9be, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:08.288683 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.301805 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] For port 5953e204-5211-4d54-80a6-f7d2b566b9be, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=5953e204-5211-4d54-80a6-f7d2b566b9be,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:08.319082 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.341515 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.361529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.378345 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d84d6902-14ab-4436-8b89-706e601bab1c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.502312 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48680288-2901-4da7-a447-59a1b7f4546d req-5fd63cac-0e9d-4c3a-9c49-084d9c372ad3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1728113 Nov 18 21:02:08.526653 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34990) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:08.540415 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-393a5b0a-834a-4962-b0a4-b4fc2beee5f7 None None] Pushing event updated for resources: {'Port': ['ID=5953e204-5211-4d54-80a6-f7d2b566b9be,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:08.577553 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.580344 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:08.581577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.588055 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device a615f218-b382-4149-860b-310ec91bd3fe up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:08.638864 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aac80b2-5659-4cc7-9266-2db221dec9bc req-4e9c811a-af55-4da6-bb1a-7cd1249379c0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:08.647639 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6aac80b2-5659-4cc7-9266-2db221dec9bc req-4e9c811a-af55-4da6-bb1a-7cd1249379c0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.3297253 Nov 18 21:02:08.653605 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-68281abd-28e0-419c-b6b2-0f7649ad1c15 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d84c0234ebde42a9a24ece0729b10890&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1256030 Nov 18 21:02:08.676879 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port a615f218-b382-4149-860b-310ec91bd3fe triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:08.677262 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.686753 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 34992) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:08.691554 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.718577 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 2.4307172 Nov 18 21:02:08.743758 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 34994) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:08.762574 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Request body: {'subnet': {'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1335391601-subnet', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:08.788468 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0064cd46-688f-4a3e-bb23-2b583127a9f5 admin admin] Pushing event updated for resources: {'Network': ['ID=95263b3e-fd72-450c-984a-4cc58b6e2e30,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:08.798267 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d84d6902-14ab-4436-8b89-706e601bab1c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.802029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d84d6902-14ab-4436-8b89-706e601bab1c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.810522 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-d84d6902-14ab-4436-8b89-706e601bab1c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/b9e9003b-ffdf-46e7-a862-8f8db81ea525 HTTP/1.1" status: 204 len: 168 time: 1.1436744 Nov 18 21:02:08.820747 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:08.829292 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:02:08.853136 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d84d6902-14ab-4436-8b89-706e601bab1c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b9e9003b-ffdf-46e7-a862-8f8db81ea525,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:08.868571 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Made reservation on behalf of d0f1cb43ab064a5388db98bf6b8228fa for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:08.872338 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.036315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-74d9891d-a401-49e7-a43a-66c8352ffc2c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.109718 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6aac80b2-5659-4cc7-9266-2db221dec9bc req-81813544-c4db-43bc-8d28-efada03f3443 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4611292 Nov 18 21:02:09.283757 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.292278 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 76221db7-7a26-4eba-b39a-1b8a36a04f16 {{(pid=102670) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:02:09.301337 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.320581 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.provisioning_blocks [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Transition to ACTIVE for port object 76221db7-7a26-4eba-b39a-1b8a36a04f16 will not be triggered until provisioned by entity L2. {{(pid=102670) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:02:09.333620 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Pushing event updated for resources: {'Subnet': ['ID=6050df59-9d5e-44e2-bfe4-f42645dc02a5,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:09.339164 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.401221 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-74d9891d-a401-49e7-a43a-66c8352ffc2c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.410378 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Checking segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:09.410983 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Network hostable DHCP agents. Network: 95263b3e-fd72-450c-984a-4cc58b6e2e30, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:02:09.445662 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:02:09.463221 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 95263b3e-fd72-450c-984a-4cc58b6e2e30) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:09.470458 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:09.472264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.481342 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-811fcd8c-2002-4b6c-98b0-1cc24f1e856e None None] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:09.525291 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5b7695fe-e0ff-4abc-8a15-4cdebc41084e admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.7790205 Nov 18 21:02:09.526357 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35008) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:09.545560 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:09.597230 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.599469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.650174 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Pushing event updated for resources: {'Port': ['ID=76221db7-7a26-4eba-b39a-1b8a36a04f16,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:09.694712 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.828668 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Allocated IP 172.27.3.94 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/fc4d4a5d-7fdc-41d6-a988-f36029e6ef39) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:09.901127 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-74d9891d-a401-49e7-a43a-66c8352ffc2c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.904975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-74d9891d-a401-49e7-a43a-66c8352ffc2c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:09.905722 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-74d9891d-a401-49e7-a43a-66c8352ffc2c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/c187060e-d2ce-4a0f-a084-e32892be1597 HTTP/1.1" status: 204 len: 168 time: 1.2173271 Nov 18 21:02:09.976131 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-95263b3e-fd72-450c-984a-4cc58b6e2e30', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:02:09.976986 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.166584 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Attempting to bind port 76221db7-7a26-4eba-b39a-1b8a36a04f16 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:10.167915 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Attempting to bind port 76221db7-7a26-4eba-b39a-1b8a36a04f16 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:10.168683 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Attempting to bind port 76221db7-7a26-4eba-b39a-1b8a36a04f16 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:10.182824 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35022) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:10.245456 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Port 76221db7-7a26-4eba-b39a-1b8a36a04f16 on network 2d6a6844-15e6-4a14-9103-24e890fa190f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:02:10.253836 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Attempting to bind port 76221db7-7a26-4eba-b39a-1b8a36a04f16 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:10.290485 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-74d9891d-a401-49e7-a43a-66c8352ffc2c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c187060e-d2ce-4a0f-a084-e32892be1597,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:10.317896 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Allocated IP 172.20.0.2 (95263b3e-fd72-450c-984a-4cc58b6e2e30/6050df59-9d5e-44e2-bfe4-f42645dc02a5/cf344c4a-1b6f-4a66-9a2b-e496beb5e932) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:10.339019 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 1, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:10.343269 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Checking segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:10.349101 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Bound using segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:10.350596 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Bound port: 76221db7-7a26-4eba-b39a-1b8a36a04f16, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:10.351339 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.392580 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.449935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d94b24ec-466b-41c9-8451-20efc453024c req-8fafaef9-91e1-49b3-af8a-376464322041 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:10.465885 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d94b24ec-466b-41c9-8451-20efc453024c req-8fafaef9-91e1-49b3-af8a-376464322041 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 943 time: 0.6267202 Nov 18 21:02:10.494867 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.538146 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-002f6894-7d50-4964-befd-0634766b89bd None None] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:10.566603 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 5953e204-5211-4d54-80a6-f7d2b566b9be up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:10.677008 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d94b24ec-466b-41c9-8451-20efc453024c req-054b848d-a9ff-43a1-9541-ba54b2b41eb4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2104797 Nov 18 21:02:10.682761 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.730825 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b4c0a3dd-38df-4278-9330-663db9358b1f admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.904400 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:10.917295 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-cf43f781-8b11-4b79-97d5-28527460b8af None None] Provisioning complete for port 5953e204-5211-4d54-80a6-f7d2b566b9be triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:10.918082 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf43f781-8b11-4b79-97d5-28527460b8af None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:10.929252 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:10.947433 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:11.003571 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cfaf3f9a-f521-44a9-b5ca-acde55a696f6 req-ded3ea0a-9f0c-4499-b146-5a58b3eeea02 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:11.006326 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cfaf3f9a-f521-44a9-b5ca-acde55a696f6 req-ded3ea0a-9f0c-4499-b146-5a58b3eeea02 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.6283488 Nov 18 21:02:11.032485 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.045971 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf43f781-8b11-4b79-97d5-28527460b8af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.057774 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.090308 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] For port 76221db7-7a26-4eba-b39a-1b8a36a04f16, host hv-cinder-79987, cleared binding levels {{(pid=102670) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:11.118472 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35048) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:11.143630 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-cf43f781-8b11-4b79-97d5-28527460b8af None None] For port 5953e204-5211-4d54-80a6-f7d2b566b9be, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=5953e204-5211-4d54-80a6-f7d2b566b9be,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:11.171570 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf43f781-8b11-4b79-97d5-28527460b8af None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.236165 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] For port 76221db7-7a26-4eba-b39a-1b8a36a04f16, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102670) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:11.243318 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Pushing event updated for resources: {'Port': ['ID=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:11.263999 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 5953e204-5211-4d54-80a6-f7d2b566b9be triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:11.264404 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.291907 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Allocated IP 172.27.3.2 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/519929a2-1d7a-4c44-aee6-01acb44dddc3) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:11.299451 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.361493 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.385732 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf43f781-8b11-4b79-97d5-28527460b8af None None] Pushing event updated for resources: {'Port': ['ID=5953e204-5211-4d54-80a6-f7d2b566b9be,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:11.398223 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.433367 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.480668 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Pushing event updated for resources: {'Port': ['ID=76221db7-7a26-4eba-b39a-1b8a36a04f16,revision_number=3']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:11.503418 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-975572875-network', 'tenant_id': '851311932c184209baa31bf73923469b'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:11.503720 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:11.513941 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:11.516993 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:11.526423 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Pushing event updated for resources: {'Port': ['ID=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:11.544882 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.560085 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cfaf3f9a-f521-44a9-b5ca-acde55a696f6 req-d81347bf-6078-4a21-b90b-8f13c9350b47 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4727774 Nov 18 21:02:11.604380 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Made reservation on behalf of 851311932c184209baa31bf73923469b for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:11.607056 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.628293 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:11.638247 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Attempting to bind port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:11.638925 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Attempting to bind port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:11.639502 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Attempting to bind port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 on network 95263b3e-fd72-450c-984a-4cc58b6e2e30 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:11.647585 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:11.648461 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Checking segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:11.649115 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.649758 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Bound using segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:11.649973 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:11.650747 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Bound port: cf344c4a-1b6f-4a66-9a2b-e496beb5e932, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:11.651359 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.663481 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:11.674747 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.679686 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:11.680256 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.681752 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-50a2c08c-552c-43da-b402-9755ddee37e0 service neutron] 10.222.0.62 "PUT /v2.0/ports/76221db7-7a26-4eba-b39a-1b8a36a04f16 HTTP/1.1" status: 200 len: 1093 time: 3.6026711 Nov 18 21:02:11.685428 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'tag': '76221db7-7a26-4eba-b39a-1b8a36a04f16'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:02:11.690526 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81378249-b016-45a9-886b-1a51a917100f" -d '{"events": [{"name": "network-changed", "server_uuid": "b7abb666-bcb4-421d-97b8-4cc7bc73f17e", "tag": "76221db7-7a26-4eba-b39a-1b8a36a04f16"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:02:11.773701 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Pushing event updated for resources: {'Port': ['ID=519929a2-1d7a-4c44-aee6-01acb44dddc3,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:11.830736 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] For port cf344c4a-1b6f-4a66-9a2b-e496beb5e932, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:11.837430 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] For port cf344c4a-1b6f-4a66-9a2b-e496beb5e932, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:11.844912 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.871986 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b4c0a3dd-38df-4278-9330-663db9358b1f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.888658 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:02:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1da712af-c836-480d-8654-94adb9cacb80 x-openstack-request-id: req-1da712af-c836-480d-8654-94adb9cacb80 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:02:11.889945 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b7abb666-bcb4-421d-97b8-4cc7bc73f17e", "tag": "76221db7-7a26-4eba-b39a-1b8a36a04f16", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:02:11.890677 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-1da712af-c836-480d-8654-94adb9cacb80 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:02:11.891560 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'tag': '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'status': 'completed', 'code': 200} Nov 18 21:02:11.918471 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b4c0a3dd-38df-4278-9330-663db9358b1f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:11.957485 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e06c9c59-9b14-4eeb-9535-39ed712656d6 None None] Pushing event updated for resources: {'Port': ['ID=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:12.047058 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b4c0a3dd-38df-4278-9330-663db9358b1f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d1d1e7da-c1c6-4964-b880-86b8ed42ab3e,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:12.062578 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-b4c0a3dd-38df-4278-9330-663db9358b1f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e64c09fceed24334ad2a73ea1b2da78d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.8628778 Nov 18 21:02:12.067444 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35066) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:12.146629 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-7ce0d6a7-3e70-495a-a5f5-3cb0d6a85f96 None None] Provisioning complete for port 5953e204-5211-4d54-80a6-f7d2b566b9be triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:12.148185 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7ce0d6a7-3e70-495a-a5f5-3cb0d6a85f96 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.165162 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-21b9f61b-f382-4a15-837c-eb32958effde admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.252553 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-d17c4e58-9d17-408e-a786-f3b0313d97da service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:12.255242 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-d17c4e58-9d17-408e-a786-f3b0313d97da service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 1096 time: 0.4248807 Nov 18 21:02:12.264304 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-21b9f61b-f382-4a15-837c-eb32958effde admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.496748 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 5953e204-5211-4d54-80a6-f7d2b566b9be up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:12.520652 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c0776dd-1c8d-4056-90e2-c41d8d7d1ed7 req-4ecdd51f-7d7b-4bab-9620-8c71f8ed7703 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:12.529474 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.529741 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9c0776dd-1c8d-4056-90e2-c41d8d7d1ed7 req-4ecdd51f-7d7b-4bab-9620-8c71f8ed7703 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 943 time: 0.4868405 Nov 18 21:02:12.544744 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-90a3369a-73a9-4e06-8817-9bacbbcb9648 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16 HTTP/1.1" status: 200 len: 217 time: 0.1358478 Nov 18 21:02:12.664955 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 5953e204-5211-4d54-80a6-f7d2b566b9be triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:12.665345 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.746311 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b0fab808-0011-4a37-9d13-221c648bea48 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:12.749763 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-b0fab808-0011-4a37-9d13-221c648bea48 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.1749678 Nov 18 21:02:12.759091 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.775130 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-21b9f61b-f382-4a15-837c-eb32958effde admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.777259 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-21b9f61b-f382-4a15-837c-eb32958effde admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.781234 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-21b9f61b-f382-4a15-837c-eb32958effde admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d1d1e7da-c1c6-4964-b880-86b8ed42ab3e HTTP/1.1" status: 204 len: 168 time: 0.7106264 Nov 18 21:02:12.781402 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.805551 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:12.934165 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-9d85bcd1-8a82-4235-816d-16756c22d8ed service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1476629 Nov 18 21:02:12.948190 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9c0776dd-1c8d-4056-90e2-c41d8d7d1ed7 req-d2b49894-9182-488d-ae3a-1ef786a162da tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4175382 Nov 18 21:02:12.949251 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 643} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:02:12.960912 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21b9f61b-f382-4a15-837c-eb32958effde admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d1d1e7da-c1c6-4964-b880-86b8ed42ab3e,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:13.026900 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40706123-7a7a-410b-96d5-30d61491704c req-005a528c-91bd-44f6-9736-8384ad15b9fe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:13.029890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40706123-7a7a-410b-96d5-30d61491704c req-005a528c-91bd-44f6-9736-8384ad15b9fe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2800117 Nov 18 21:02:13.038143 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.047347 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d7355816-4070-4155-99bc-14b88fcea03e,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:13.107617 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.108384 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Added segment a71d8294-97d3-4004-81eb-f3aa0b67272e of type vlan for network 114fdaf6-871a-4adc-a451-0c84b8e723ab Nov 18 21:02:13.273542 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.302215 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40706123-7a7a-410b-96d5-30d61491704c req-920b56ee-54ea-4b35-873f-f606d613f6b8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2613361 Nov 18 21:02:13.315404 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102669) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:02:13.424193 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-f45d8d9d-6412-4487-8afe-ce5100236ac7 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4719250 Nov 18 21:02:13.427389 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.db.resource_extend [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] It took 0.13 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 21:02:13.485117 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:13.503600 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Sync routers for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:13.535887 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.539411 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:13.541089 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:13.542412 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-723ea968-4bf6-4ba7-b605-1916740e4d35 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 919 time: 4.0096850 Nov 18 21:02:13.544170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35090) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:13.619778 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35094) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:13.635904 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.637599 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:13.638413 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.673534 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d9b0d757-46f9-441b-a046-ae0e8a1b0af6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:13.702355 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d3f72b9f-64a1-4241-a668-c853eba9b60f None None] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:13.787711 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:13.822005 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-af42dfe2-92b1-4b40-ba96-41ee6e5ccf6d None None] Provisioning complete for port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:13.822330 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-af42dfe2-92b1-4b40-ba96-41ee6e5ccf6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.084535 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d9b0d757-46f9-441b-a046-ae0e8a1b0af6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.086118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35100) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:14.099266 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d9b0d757-46f9-441b-a046-ae0e8a1b0af6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.141914 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 2.9673891 Nov 18 21:02:14.143551 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.150635 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35104) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:14.163994 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Request body: {'subnet': {'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-975572875-subnet', 'tenant_id': '851311932c184209baa31bf73923469b', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:14.182890 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cea4679f-c9cf-4260-87f7-a8d9e4a1ba65 admin admin] Pushing event updated for resources: {'Network': ['ID=114fdaf6-871a-4adc-a451-0c84b8e723ab,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:14.183797 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9b0d757-46f9-441b-a046-ae0e8a1b0af6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6d6c9475-3738-417e-82d0-362c8c27fd21,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:14.221130 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-d9b0d757-46f9-441b-a046-ae0e8a1b0af6 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=2f019504ccc44ff38a8bd1883a45ef00&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5995839 Nov 18 21:02:14.241753 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35106) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:14.245938 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d4b01b45-cdde-4991-a5d1-9b06ca2881b7 req-ddce3e8c-71e9-4ae2-b062-463dc5d972b0 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8016634 Nov 18 21:02:14.299404 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 114fdaf6-871a-4adc-a451-0c84b8e723ab details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:02:14.476738 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Made reservation on behalf of 851311932c184209baa31bf73923469b for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:14.480082 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6003637'] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.551246 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:12Z', 'revision_number': 3, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:11Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:14.586007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-af42dfe2-92b1-4b40-ba96-41ee6e5ccf6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.589904 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device cf344c4a-1b6f-4a66-9a2b-e496beb5e932 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:14.604185 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Checking router: 7ff3c29a-4ec9-401d-888e-f0fe474fba95 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:14.604781 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Updating router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 port 519929a2-1d7a-4c44-aee6-01acb44dddc3 binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:14.652078 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b2e9917-9cd9-45f0-8094-fbb548011d62 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.654686 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.663269 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-af42dfe2-92b1-4b40-ba96-41ee6e5ccf6d None None] For port cf344c4a-1b6f-4a66-9a2b-e496beb5e932, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:14.669148 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-af42dfe2-92b1-4b40-ba96-41ee6e5ccf6d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.681146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c80404c-2332-419f-95fc-eaf545e11017 req-c75bd7c1-256a-47d9-ae15-faf52c5a3ea6 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:14.682730 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6c80404c-2332-419f-95fc-eaf545e11017 req-c75bd7c1-256a-47d9-ae15-faf52c5a3ea6 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 943 time: 0.4647422 Nov 18 21:02:14.730373 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af42dfe2-92b1-4b40-ba96-41ee6e5ccf6d None None] Pushing event updated for resources: {'Port': ['ID=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:14.761436 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:14.762363 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.800096 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-014b4e34-c90e-4a27-b694-e848a40fd715 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.841222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-a2372946-522b-4f26-a80f-48c07208a5eb None None] Provisioning complete for port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:14.841580 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a2372946-522b-4f26-a80f-48c07208a5eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.890928 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5840016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6003623'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.914033 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-014b4e34-c90e-4a27-b694-e848a40fd715 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:14.923665 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6c80404c-2332-419f-95fc-eaf545e11017 req-910387de-2113-44ed-8ead-710c130bc826 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1855581 Nov 18 21:02:15.057526 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc71926c-e8c1-4989-88d6-71eff6ff82a7 req-45f54f4c-d02d-42dc-9472-be2ec4c064fe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:15.059625 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fc71926c-e8c1-4989-88d6-71eff6ff82a7 req-45f54f4c-d02d-42dc-9472-be2ec4c064fe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.4684193 Nov 18 21:02:15.062183 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81378249-b016-45a9-886b-1a51a917100f req-67b4649c-e701-47a0-b711-2ae3184b5f39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:15.064697 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-67b4649c-e701-47a0-b711-2ae3184b5f39 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 1096 time: 0.6465557 Nov 18 21:02:15.142324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Checking segment: {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:15.142985 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Network hostable DHCP agents. Network: 114fdaf6-871a-4adc-a451-0c84b8e723ab, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:02:15.188090 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.197927 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.230081 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Pushing event updated for resources: {'Subnet': ['ID=e48c8bc2-bbdc-434c-9eda-2ef0cb808732,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:15.274727 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b612847a-1121-445f-b4af-293d872ba9f5 None None] Pushing event updated for resources: {'Port': ['ID=519929a2-1d7a-4c44-aee6-01acb44dddc3,revision_number=2']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:15.282381 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Attempting to bind port 519929a2-1d7a-4c44-aee6-01acb44dddc3 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:15.282658 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Attempting to bind port 519929a2-1d7a-4c44-aee6-01acb44dddc3 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:15.283210 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Attempting to bind port 519929a2-1d7a-4c44-aee6-01acb44dddc3 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:15.293848 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:15.295321 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:15.295321 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.295613 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:15.296833 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Bound port: 519929a2-1d7a-4c44-aee6-01acb44dddc3, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:15.297151 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.341863 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fc71926c-e8c1-4989-88d6-71eff6ff82a7 req-01e847ef-8ef9-4cf2-885e-f81be5b228ae tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2703087 Nov 18 21:02:15.356722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Router 9a562b78-48b6-4a2c-9aec-0371a3e670cf is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102670) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:02:15.390994 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Network 114fdaf6-871a-4adc-a451-0c84b8e723ab is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:02:15.402055 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] For port 519929a2-1d7a-4c44-aee6-01acb44dddc3, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:15.410637 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] For port 519929a2-1d7a-4c44-aee6-01acb44dddc3, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=519929a2-1d7a-4c44-aee6-01acb44dddc3,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:15.419468 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.427335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b2e9917-9cd9-45f0-8094-fbb548011d62 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.457725 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8b2e9917-9cd9-45f0-8094-fbb548011d62 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.458049 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 114fdaf6-871a-4adc-a451-0c84b8e723ab) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:15.467969 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:15.468626 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.475091 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81378249-b016-45a9-886b-1a51a917100f req-8370b3e0-e1d5-4ca0-999b-789732b1cf62 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:15.477179 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-8370b3e0-e1d5-4ca0-999b-789732b1cf62 service neutron] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 915 time: 0.3915384 Nov 18 21:02:15.499010 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7032cee1-a86b-4ce6-8fe8-b2a87fe69943 None None] Network 114fdaf6-871a-4adc-a451-0c84b8e723ab requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:15.504312 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-014b4e34-c90e-4a27-b694-e848a40fd715 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.510179 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-014b4e34-c90e-4a27-b694-e848a40fd715 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.512205 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-014b4e34-c90e-4a27-b694-e848a40fd715 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6d6c9475-3738-417e-82d0-362c8c27fd21 HTTP/1.1" status: 204 len: 168 time: 1.2685819 Nov 18 21:02:15.525038 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b612847a-1121-445f-b4af-293d872ba9f5 None None] Pushing event updated for resources: {'Port': ['ID=519929a2-1d7a-4c44-aee6-01acb44dddc3,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:15.543053 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.543627 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:15.545072 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:15.552082 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8b2e9917-9cd9-45f0-8094-fbb548011d62 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=401d91e0d2264220a414d0f83b8757e6&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4631507 Nov 18 21:02:15.566264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35116) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:15.567272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8b2e9917-9cd9-45f0-8094-fbb548011d62 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6485108f-b6f7-4ccd-ad04-d0c2a7ad2b43,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:15.661481 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014b4e34-c90e-4a27-b694-e848a40fd715 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6d6c9475-3738-417e-82d0-362c8c27fd21,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:15.740892 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:15.766080 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-918140ef-9477-4689-909d-364c9c16aa5a service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16 HTTP/1.1" status: 200 len: 217 time: 0.2713029 Nov 18 21:02:15.782562 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a825a396-9a9f-443a-ba31-7ed6fc5b7448 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.6141977 Nov 18 21:02:15.782562 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.782562 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-e7267364-93dc-4cab-86ca-c6116b90c9c3 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 8.9097359 Nov 18 21:02:15.782562 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35120) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:15.788266 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Sync routers for ids ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:15.860581 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-08e46713-80ca-4967-89f5-e22d28fa6b07 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:15.913013 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:15.921693 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ae9e1002-8e3a-45fe-b277-ca2926d8a1bd None None] Network 114fdaf6-871a-4adc-a451-0c84b8e723ab requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:15.925479 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Routers {'9a562b78-48b6-4a2c-9aec-0371a3e670cf'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:15.926503 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:15.988276 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-08e46713-80ca-4967-89f5-e22d28fa6b07 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:16.074563 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81378249-b016-45a9-886b-1a51a917100f req-f1aba17a-48ae-4192-aeb2-64092186af3a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:16.078434 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-f1aba17a-48ae-4192-aeb2-64092186af3a service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.3001292 Nov 18 21:02:16.235252 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Allocated IP 172.20.0.1 (95263b3e-fd72-450c-984a-4cc58b6e2e30/6050df59-9d5e-44e2-bfe4-f42645dc02a5/0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:16.301287 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-08e46713-80ca-4967-89f5-e22d28fa6b07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:16.304479 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-08e46713-80ca-4967-89f5-e22d28fa6b07 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:16.312018 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-08e46713-80ca-4967-89f5-e22d28fa6b07 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6485108f-b6f7-4ccd-ad04-d0c2a7ad2b43 HTTP/1.1" status: 204 len: 168 time: 0.7246776 Nov 18 21:02:16.354566 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-a2763930-55be-492b-b996-e9cce490c7c8 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1529391 Nov 18 21:02:16.414787 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-08e46713-80ca-4967-89f5-e22d28fa6b07 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6485108f-b6f7-4ccd-ad04-d0c2a7ad2b43,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:16.448326 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e90ac2fc-4473-422e-8b19-eddc118db14e req-6db709f8-9bae-4c63-97cd-52ebf3e5e66c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:16.455974 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:12Z', 'revision_number': 3, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:16.460897 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e90ac2fc-4473-422e-8b19-eddc118db14e req-6db709f8-9bae-4c63-97cd-52ebf3e5e66c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 943 time: 0.3415101 Nov 18 21:02:16.537794 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-9ecabcd0-1f05-4af3-82a1-fbbabc6e8acf service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1667664 Nov 18 21:02:16.560975 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5e7e7a8b-7842-46e1-aa76-41579e13a5b7 None None] The sync data for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi is: [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:12Z', 'revision_number': 3, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:15Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:16.621030 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device cf344c4a-1b6f-4a66-9a2b-e496beb5e932 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:16.639835 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:16.646388 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e90ac2fc-4473-422e-8b19-eddc118db14e req-27357890-08d5-4e0b-b4f6-6b51b37a811d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1778600 Nov 18 21:02:16.708718 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:16.857054 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:16.870592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:16.877692 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:16.884365 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-81378249-b016-45a9-886b-1a51a917100f req-d69dc129-dc2b-4380-b4e2-001bba143038 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3279266 Nov 18 21:02:16.892338 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Pushing event updated for resources: {'Port': ['ID=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:16.916944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Set router 9a562b78-48b6-4a2c-9aec-0371a3e670cf gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:16.960276 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad126f5e-2c32-46f6-b15f-4176b6ebd6b4 req-10277b16-a486-4f70-8870-0595dacd9670 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:16.962854 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ad126f5e-2c32-46f6-b15f-4176b6ebd6b4 req-10277b16-a486-4f70-8870-0595dacd9670 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2583447 Nov 18 21:02:17.009727 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.377929 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.386985 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:17.387373 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.548179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-dd0a2dad-6e44-420c-b29f-a0646b65d8f2 None None] Provisioning complete for port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:17.548853 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dd0a2dad-6e44-420c-b29f-a0646b65d8f2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.599056 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-dd0a2dad-6e44-420c-b29f-a0646b65d8f2 None None] Port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:17.602033 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:02:12Z', 'revision_number': 3, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:17.624431 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35156) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:17.637353 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Checking router: 9a562b78-48b6-4a2c-9aec-0371a3e670cf for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:17.637989 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Updating router 9a562b78-48b6-4a2c-9aec-0371a3e670cf port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:17.667033 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.678324 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ad126f5e-2c32-46f6-b15f-4176b6ebd6b4 req-d9830367-9a70-4d75-b1ed-5c9fe7842e91 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6974943 Nov 18 21:02:17.747911 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.775524 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a52d37ae-5b07-4c7d-8cea-8b67f538f74d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:17.981508 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.000874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.086869 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7520f4c5-429a-4631-9b29-03923a8ca9ed req-246d2bee-ba69-4b5d-83dd-344ed6aac314 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:18.097572 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7520f4c5-429a-4631-9b29-03923a8ca9ed req-246d2bee-ba69-4b5d-83dd-344ed6aac314 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 943 time: 0.3129029 Nov 18 21:02:18.211356 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.333901 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a52d37ae-5b07-4c7d-8cea-8b67f538f74d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.370065 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 76221db7-7a26-4eba-b39a-1b8a36a04f16 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:02:18.388901 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Pushing event updated for resources: {'Port': ['ID=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:18.403847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a52d37ae-5b07-4c7d-8cea-8b67f538f74d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.525737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a52d37ae-5b07-4c7d-8cea-8b67f538f74d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2128f46b-0891-4a0e-8e7a-2d0444c1555c,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:18.561812 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a52d37ae-5b07-4c7d-8cea-8b67f538f74d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=4edfa8c0f6cd4025aecc396bfd9400e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9227872 Nov 18 21:02:18.562873 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35168) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:18.571234 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.581738 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 519929a2-1d7a-4c44-aee6-01acb44dddc3 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:18.604166 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7520f4c5-429a-4631-9b29-03923a8ca9ed req-736d765b-fe76-4a5a-94c0-bd5d04307ccb tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5015426 Nov 18 21:02:18.646010 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.697607 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Allocated IP 172.20.0.1 (45e03d28-5c3b-481b-81f0-d332c4379a09/07eef04b-f3f6-4ee0-b23d-7f9f86f27c94/84b73196-fb77-4c26-90a2-6d6283a3588e) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:18.717870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:18.738140 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:18.749661 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36240d0f-19d3-4844-96c6-fa9164ae1b07 None None] Pushing event updated for resources: {'Port': ['ID=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:18.783409 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7bcc56b0-02e6-4bfa-87e1-03f70319bfc2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.844970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Attempting to bind port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:18.846074 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Attempting to bind port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:18.847068 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Attempting to bind port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:18.862240 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:18.863466 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:18.864509 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.867425 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:18.868754 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Bound port: fc4d4a5d-7fdc-41d6-a988-f36029e6ef39, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:18.869747 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:18.969995 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.026817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 519929a2-1d7a-4c44-aee6-01acb44dddc3 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:19.027886 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.031251 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.099642 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Pushing event updated for resources: {'Port': ['ID=84b73196-fb77-4c26-90a2-6d6283a3588e,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:19.099882 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 76221db7-7a26-4eba-b39a-1b8a36a04f16, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:19.108224 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:02:19.121031 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:19.123621 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:19.124858 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7bcc56b0-02e6-4bfa-87e1-03f70319bfc2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.140879 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:19.218791 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.366018 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] For port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:19.372332 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'port_id': '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'mac_address': 'fa:16:3e:07:a2:d8', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 604, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fcebaf13-b181-404f-a8e5-52ddbe0c8c7c', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:02:19.377315 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56a3991d-5732-45ba-9c7e-4b43910f36db req-77688187-3129-4e56-82b6-452040b3cb66 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:19.384235 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] For port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:19.385092 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-56a3991d-5732-45ba-9c7e-4b43910f36db req-77688187-3129-4e56-82b6-452040b3cb66 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.3475988 Nov 18 21:02:19.402103 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.404646 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.607376 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Routers {'9a562b78-48b6-4a2c-9aec-0371a3e670cf'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:19.608433 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:19.669801 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7bcc56b0-02e6-4bfa-87e1-03f70319bfc2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.675878 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7bcc56b0-02e6-4bfa-87e1-03f70319bfc2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:19.679405 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7bcc56b0-02e6-4bfa-87e1-03f70319bfc2 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2128f46b-0891-4a0e-8e7a-2d0444c1555c HTTP/1.1" status: 204 len: 168 time: 1.1132054 Nov 18 21:02:19.710909 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bcc56b0-02e6-4bfa-87e1-03f70319bfc2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2128f46b-0891-4a0e-8e7a-2d0444c1555c,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:19.748964 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-56a3991d-5732-45ba-9c7e-4b43910f36db req-a2f0572a-438f-4398-8273-de327f8fab45 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3168685 Nov 18 21:02:19.767128 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:19.795650 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-99dfe178-f8f4-4e51-879d-a1eec0416529 admin admin] 10.222.0.61 "PUT /v2.0/routers/7ff3c29a-4ec9-401d-888e-f0fe474fba95/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.2455878 Nov 18 21:02:20.018463 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-aabe8dce-d38b-4001-8202-91bd966dce27 None None] Provisioning complete for port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:20.022260 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aabe8dce-d38b-4001-8202-91bd966dce27 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.031977 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.039222 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.049152 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86d99cd2-4570-40bf-a6e1-ffbc494cb150 req-a3f73ba4-9cf5-4ce6-b6b2-8c2b8e1e03eb tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:20.051608 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-86d99cd2-4570-40bf-a6e1-ffbc494cb150 req-a3f73ba4-9cf5-4ce6-b6b2-8c2b8e1e03eb tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 943 time: 0.1790426 Nov 18 21:02:20.094227 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-36240d0f-19d3-4844-96c6-fa9164ae1b07 None None] Pushing event updated for resources: {'Port': ['ID=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:20.204933 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-86d99cd2-4570-40bf-a6e1-ffbc494cb150 req-f4efadaf-175d-40f6-8c4c-a0d4840a5d91 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1257985 Nov 18 21:02:20.217553 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 76221db7-7a26-4eba-b39a-1b8a36a04f16 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:02:20.231860 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.281559 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 76221db7-7a26-4eba-b39a-1b8a36a04f16, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:20.289557 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-aabe8dce-d38b-4001-8202-91bd966dce27 None None] Port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:20.297464 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 519929a2-1d7a-4c44-aee6-01acb44dddc3, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=519929a2-1d7a-4c44-aee6-01acb44dddc3,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:20.299606 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.305845 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] Set router 9a562b78-48b6-4a2c-9aec-0371a3e670cf gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:20.311562 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-ed62ea8d-6ff4-4c69-951f-65517195dd47 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:20.319307 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-ed62ea8d-6ff4-4c69-951f-65517195dd47 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/networks?id=114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 200 len: 808 time: 0.4975030 Nov 18 21:02:20.383899 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-58dc02a4-cfe2-4ec3-8c38-a3ae6fa1a458 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/quotas/851311932c184209baa31bf73923469b HTTP/1.1" status: 200 len: 375 time: 0.0632191 Nov 18 21:02:20.425423 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.441135 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-d594861f-a475-4b7d-98ef-b343c133b553 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=851311932c184209baa31bf73923469b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0558825 Nov 18 21:02:20.512346 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Sync routers for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:20.543957 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:20.545461 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:20.581422 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-94d887bc-691a-44fd-82fc-a367f73db228 None None] Provisioning complete for port 84b73196-fb77-4c26-90a2-6d6283a3588e triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:20.582008 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-94d887bc-691a-44fd-82fc-a367f73db228 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.714401 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.734011 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:20.741803 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-72893cc2-ae86-453c-8b05-c88b3761a79c service neutron] 10.222.0.61 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2990837 Nov 18 21:02:20.762779 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:20.910026 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Pushing event updated for resources: {'Port': ['ID=84b73196-fb77-4c26-90a2-6d6283a3588e,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:20.928310 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['76221db7-7a26-4eba-b39a-1b8a36a04f16'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:02:20.949999 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=76221db7-7a26-4eba-b39a-1b8a36a04f16,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:20.965589 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:21.089239 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 2, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:21.111337 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-dec75d23-b58b-4af7-ba89-a0fa7e5628b7 service neutron] 10.222.0.61 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3688405 Nov 18 21:02:21.129603 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b8ff96a-f1ae-473b-82ff-103e85a4ecf4 req-7047614f-2598-41b7-9c11-5e4620a606b6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:21.141320 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5b8ff96a-f1ae-473b-82ff-103e85a4ecf4 req-7047614f-2598-41b7-9c11-5e4620a606b6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1604443 Nov 18 21:02:21.203751 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Checking router: 7ff3c29a-4ec9-401d-888e-f0fe474fba95 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:21.206624 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Updating router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:21.234937 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:21.238922 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:21.258850 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-94d887bc-691a-44fd-82fc-a367f73db228 None None] Port 84b73196-fb77-4c26-90a2-6d6283a3588e cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:21.282559 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5b8ff96a-f1ae-473b-82ff-103e85a4ecf4 req-5ed1f36b-b2bc-4f6c-b9d5-82db4b530a3d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1395979 Nov 18 21:02:21.305517 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:21.548589 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Router 9a562b78-48b6-4a2c-9aec-0371a3e670cf has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:02:21.644196 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:02:12Z', 'revision_number': 3, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:21.731259 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45542533-b1ab-4126-917e-dcc0a5f71043 req-e6757faf-a80c-47c7-ac04-d31c893698ff tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:21.737334 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45542533-b1ab-4126-917e-dcc0a5f71043 req-e6757faf-a80c-47c7-ac04-d31c893698ff tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 944 time: 0.2274339 Nov 18 21:02:21.738093 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35254) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:21.766222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dfe036ec-ac24-4cb1-a527-7ee999ccd6df None None] The sync data for ids ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'] in dv-cinder-799871-8-iscsi is: [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:02:12Z', 'revision_number': 3, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:21.776960 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1362082646-network', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:21.898035 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=519929a2-1d7a-4c44-aee6-01acb44dddc3,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:21.946176 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:21.959490 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-3567ab1a-9273-49e4-a916-7f38bda7364a None None] Provisioning complete for port 84b73196-fb77-4c26-90a2-6d6283a3588e triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:21.960581 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-3567ab1a-9273-49e4-a916-7f38bda7364a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:21.975486 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-d0d215d2-931b-4f12-95d9-30dc3e7144c1 admin admin] 10.222.0.61 "PUT /v2.0/routers/9a562b78-48b6-4a2c-9aec-0371a3e670cf/add_router_interface HTTP/1.1" status: 200 len: 503 time: 6.1941023 Nov 18 21:02:22.048173 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45542533-b1ab-4126-917e-dcc0a5f71043 req-c8057715-50ea-4915-af87-60b1b829bb84 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3002458 Nov 18 21:02:22.049312 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Made reservation on behalf of 3af5bd8ced1f431281230f850c7e751c for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:22.055327 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.078421 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.101999 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f81edf56-9747-4168-a417-f7e94789d152 req-77e8c057-c41f-42c8-841a-200fd8ac2c2a tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.1005452 Nov 18 21:02:22.142611 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-3567ab1a-9273-49e4-a916-7f38bda7364a None None] Port 84b73196-fb77-4c26-90a2-6d6283a3588e cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:22.365962 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.390472 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.481846 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.488916 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.557948 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 641} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:02:22.582390 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ac7447-d3ed-4032-9e22-7cf153e0fd68 None None] Pushing event updated for resources: {'Port': ['ID=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:22.704530 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2b25df98-1428-4de0-b937-40129e9239e0,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:22.724537 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.725123 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Added segment 89de1c6b-c41f-466f-9ac5-1885b681ff12 of type vlan for network 48c3801d-f9ea-49b1-bf8f-8043491d206f Nov 18 21:02:22.774911 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Attempting to bind port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:22.775574 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Attempting to bind port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:22.776769 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Attempting to bind port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a on network 95263b3e-fd72-450c-984a-4cc58b6e2e30 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:22.787886 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:22.789496 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Checking segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:22.790587 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.791547 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Bound using segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:22.792404 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Bound port: 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:22.805159 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:22.864665 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88cb34d3-5a0c-49f5-a711-83be1896f199 req-ffddef6f-5de9-412d-8f12-072c67dd55d6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:22.877808 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88cb34d3-5a0c-49f5-a711-83be1896f199 req-ffddef6f-5de9-412d-8f12-072c67dd55d6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.3144228 Nov 18 21:02:22.899372 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:22.914572 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.007983 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88cb34d3-5a0c-49f5-a711-83be1896f199 req-d8c53ccc-2244-4230-8adb-cecb24258d8a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1247921 Nov 18 21:02:23.018925 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.023111 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:23.025394 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.092007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:23.092424 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.110466 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] For port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:23.126408 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] For port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:23.141309 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.402947 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] Pushing event updated for resources: {'Network': ['ID=48c3801d-f9ea-49b1-bf8f-8043491d206f,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:23.427291 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f1c81a66-d7a4-4828-b27a-654ce39423d0 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.6878240 Nov 18 21:02:23.430669 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-85cddfcd-0b84-43ec-9ecd-7c97137749b9 req-524d8d92-2156-43cc-b3b4-37b46c626fd5 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.0955546 Nov 18 21:02:23.435434 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35304) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:23.454199 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:02:23.469041 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Request body: {'subnet': {'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1362082646-subnet', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:23.479261 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.536357 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-489732d1-779b-454f-9b2a-ec36dd8d7789 None None] Provisioning complete for port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:23.539140 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-489732d1-779b-454f-9b2a-ec36dd8d7789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.573606 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de3574f6-d838-4ccc-ba4c-1ca871dca070 req-074c597b-fb03-4e46-94d0-82b327a2c8d5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:23.585297 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-de3574f6-d838-4ccc-ba4c-1ca871dca070 req-074c597b-fb03-4e46-94d0-82b327a2c8d5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 944 time: 0.1952744 Nov 18 21:02:23.589430 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Made reservation on behalf of 3af5bd8ced1f431281230f850c7e751c for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:23.593459 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:23.696382 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-98ac7447-d3ed-4032-9e22-7cf153e0fd68 None None] Pushing event updated for resources: {'Port': ['ID=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,revision_number=4']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:23.715166 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:23.716061 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:24.021617 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:24.062944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.065291 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 519929a2-1d7a-4c44-aee6-01acb44dddc3 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:24.094421 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-de3574f6-d838-4ccc-ba4c-1ca871dca070 req-4aa769ac-a16c-4a03-b451-04f13cb81172 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5080774 Nov 18 21:02:24.101166 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:24.217328 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:24.280633 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 519929a2-1d7a-4c44-aee6-01acb44dddc3 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:24.281310 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.346590 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.391110 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41e45de7-248d-4d76-bc70-455c9c84cba8 req-c929ca56-97dd-4290-8c92-5dcfa349988b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:24.404148 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-41e45de7-248d-4d76-bc70-455c9c84cba8 req-c929ca56-97dd-4290-8c92-5dcfa349988b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2140551 Nov 18 21:02:24.410731 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-489732d1-779b-454f-9b2a-ec36dd8d7789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.501202 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Pushing event updated for resources: {'Subnet': ['ID=000d7d3c-2fa9-4900-aa84-42e72bfbb16b,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:24.510698 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-41e45de7-248d-4d76-bc70-455c9c84cba8 req-21d7fca4-389a-4b08-ae18-abd3f6108fc2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1047029 Nov 18 21:02:24.536704 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-489732d1-779b-454f-9b2a-ec36dd8d7789 None None] For port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:24.558450 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-489732d1-779b-454f-9b2a-ec36dd8d7789 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.587976 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Checking segment: {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:24.588564 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Network hostable DHCP agents. Network: 48c3801d-f9ea-49b1-bf8f-8043491d206f, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:02:24.635009 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:02:24.664495 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 48c3801d-f9ea-49b1-bf8f-8043491d206f) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:24.684772 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:24.686115 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.707788 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-61be89ab-2c85-4b79-98ef-471210273e4c req-9d6e40b4-d7b2-4eb3-bee1-24d0b367cc28 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.0603580 Nov 18 21:02:24.712703 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9c37b214-0af9-4fca-82d8-9b5fdbda3229 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.2591474 Nov 18 21:02:24.715777 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35344) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:24.720615 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:24.731157 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-70a19f00-b42a-4f98-83ae-8d39f623b617 None None] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:24.758493 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.761670 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.766927 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:23Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:24.836525 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-98cafd09-5854-4a73-bbf8-1e874c1bcd63 None None] The sync data for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi is: [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:23Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:24.844149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-505598d8-4363-4dec-8599-69e17e1c3e8d None None] Provisioning complete for port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:24.849684 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-505598d8-4363-4dec-8599-69e17e1c3e8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:24.904452 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:25.119945 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-489732d1-779b-454f-9b2a-ec36dd8d7789 None None] Pushing event updated for resources: {'Port': ['ID=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:25.160365 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:25.305583 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Sync routers for ids ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:25.311039 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-48c3801d-f9ea-49b1-bf8f-8043491d206f', 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'fixed_ips': [{'subnet_id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:02:25.311934 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:25.314540 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 76221db7-7a26-4eba-b39a-1b8a36a04f16 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:25.629173 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Allocated IP 172.20.0.2 (48c3801d-f9ea-49b1-bf8f-8043491d206f/000d7d3c-2fa9-4900-aa84-42e72bfbb16b/8db29542-8539-45cf-9b02-17e5c43fec0b) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:25.649692 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:25.719719 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Routers {'9a562b78-48b6-4a2c-9aec-0371a3e670cf'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:25.722608 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:25.775559 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-777f1a08-a4b3-46a5-b765-9433ceaef617 req-3e156380-2e1b-4af2-8c9a-5f9308f2751b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:25.782507 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-777f1a08-a4b3-46a5-b765-9433ceaef617 req-3e156380-2e1b-4af2-8c9a-5f9308f2751b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 944 time: 0.4825809 Nov 18 21:02:25.938493 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-777f1a08-a4b3-46a5-b765-9433ceaef617 req-b86bd6e4-4857-49f1-adf3-7c21a7ad26b7 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1486700 Nov 18 21:02:26.048390 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:26.051321 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.053628 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 76221db7-7a26-4eba-b39a-1b8a36a04f16 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:02:26.114619 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 76221db7-7a26-4eba-b39a-1b8a36a04f16 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:26.115200 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.190177 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-819fa19b-5b08-4477-98be-39ffd663b012 req-6d48fafd-9ef0-4a64-8987-8c9ae4a605fb tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:26.193819 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Set router 9a562b78-48b6-4a2c-9aec-0371a3e670cf gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:26.199666 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-819fa19b-5b08-4477-98be-39ffd663b012 req-6d48fafd-9ef0-4a64-8987-8c9ae4a605fb tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1257718 Nov 18 21:02:26.271038 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.278583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35378) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:26.373311 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-819fa19b-5b08-4477-98be-39ffd663b012 req-c8507b0f-6f9e-47bf-9838-e1d8dc873a42 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1720634 Nov 18 21:02:26.375079 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.528430 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1488eff-604b-4722-a1b8-3b2453a7122b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.585892 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.655652 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.666195 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-12f3c80f-b9de-42ef-9e54-737e0671cd94 req-97e6c1cf-d2a2-4077-bdeb-2a08ba66cc36 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.0490611 Nov 18 21:02:26.668949 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Allocated IP 172.27.3.185 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/0a1f5c4d-24bf-459d-b08a-b93d56088c17) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:26.794082 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.801989 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1488eff-604b-4722-a1b8-3b2453a7122b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.819677 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1488eff-604b-4722-a1b8-3b2453a7122b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.850094 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:26.874823 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:26.884236 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:26.888299 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Pushing event updated for resources: {'Port': ['ID=8db29542-8539-45cf-9b02-17e5c43fec0b,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:26.891661 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:26.917800 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c1488eff-604b-4722-a1b8-3b2453a7122b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=b1a354d0eb644214af63db6ff3b8ff81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6358685 Nov 18 21:02:26.920542 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35382) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:26.929893 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '76221db7-7a26-4eba-b39a-1b8a36a04f16'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:02:26.937617 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a298a02f-dc83-40f3-9851-86e737623a5c" -d '{"events": [{"server_uuid": "b7abb666-bcb4-421d-97b8-4cc7bc73f17e", "name": "network-vif-plugged", "status": "completed", "tag": "76221db7-7a26-4eba-b39a-1b8a36a04f16"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:02:26.949574 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:26.958891 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1488eff-604b-4722-a1b8-3b2453a7122b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=200ef562-1c9b-4c6f-9be7-f740adf5e770,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:27.044885 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:02:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-adc8112a-f603-47c8-87c7-10e766d4a03b x-openstack-request-id: req-adc8112a-f603-47c8-87c7-10e766d4a03b {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:02:27.046753 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b7abb666-bcb4-421d-97b8-4cc7bc73f17e", "name": "network-vif-plugged", "status": "completed", "tag": "76221db7-7a26-4eba-b39a-1b8a36a04f16", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:02:27.047113 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-adc8112a-f603-47c8-87c7-10e766d4a03b {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:02:27.047604 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'code': 200} Nov 18 21:02:27.051736 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 76221db7-7a26-4eba-b39a-1b8a36a04f16, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:27.053913 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e8a01ff5-7713-41b1-94d7-e739cde5a30b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.057583 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.102263 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e8a01ff5-7713-41b1-94d7-e739cde5a30b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.136285 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:27.142273 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.144366 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:27.171787 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:27.183751 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e8a01ff5-7713-41b1-94d7-e739cde5a30b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.188632 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e8a01ff5-7713-41b1-94d7-e739cde5a30b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.190277 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e8a01ff5-7713-41b1-94d7-e739cde5a30b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/200ef562-1c9b-4c6f-9be7-f740adf5e770 HTTP/1.1" status: 204 len: 168 time: 0.2683861 Nov 18 21:02:27.234060 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8a01ff5-7713-41b1-94d7-e739cde5a30b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=200ef562-1c9b-4c6f-9be7-f740adf5e770,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:27.339356 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Attempting to bind port 8db29542-8539-45cf-9b02-17e5c43fec0b on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:27.339975 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Attempting to bind port 8db29542-8539-45cf-9b02-17e5c43fec0b by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:27.340658 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Attempting to bind port 8db29542-8539-45cf-9b02-17e5c43fec0b on network 48c3801d-f9ea-49b1-bf8f-8043491d206f {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:27.370151 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Pushing event updated for resources: {'Port': ['ID=0a1f5c4d-24bf-459d-b08a-b93d56088c17,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:27.460825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:27.460825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Checking segment: {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:27.460825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.461277 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Bound using segment: {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:27.461799 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Bound port: 8db29542-8539-45cf-9b02-17e5c43fec0b, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:27.462093 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.539333 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=76221db7-7a26-4eba-b39a-1b8a36a04f16,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:27.581402 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:27.581862 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:27.687845 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68365da1-440f-4357-ab3d-7734f1efeb51 req-cfb00730-0c23-4334-ae6d-cf6ba1420596 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:27.696609 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-68365da1-440f-4357-ab3d-7734f1efeb51 req-cfb00730-0c23-4334-ae6d-cf6ba1420596 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1496370 Nov 18 21:02:27.725652 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7ee4dc2-7be0-4a02-b5fb-449ffb8f9615 req-b6c36d58-1fd6-4f9d-bc8b-90b7f9979a9b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:27.728686 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c7ee4dc2-7be0-4a02-b5fb-449ffb8f9615 req-b6c36d58-1fd6-4f9d-bc8b-90b7f9979a9b service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 1098 time: 0.1660709 Nov 18 21:02:27.745048 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5173fbb0-6f1b-4b59-81f8-a6355061f2ee req-dbcb4d84-372f-41e1-bf46-d438f5174a59 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:27.746464 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5173fbb0-6f1b-4b59-81f8-a6355061f2ee req-dbcb4d84-372f-41e1-bf46-d438f5174a59 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.6085367 Nov 18 21:02:27.815039 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:02:19Z', 'revision_number': 4, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '84b73196-fb77-4c26-90a2-6d6283a3588e', 'name': '', 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'mac_address': 'fa:16:3e:e6:34:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_interface', 'standard_attr_id': 318, 'fixed_ips': [{'subnet_id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:17Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 2, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'subnets': [{'id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:27.900633 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-68365da1-440f-4357-ab3d-7734f1efeb51 req-5049b2f2-c364-4759-a8c1-b4554b1167ed tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2027569 Nov 18 21:02:27.908639 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c7ee4dc2-7be0-4a02-b5fb-449ffb8f9615 req-23156847-1e88-46dc-a9e2-f07c9801e397 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1475439 Nov 18 21:02:27.927336 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Checking router: 9a562b78-48b6-4a2c-9aec-0371a3e670cf for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:27.928774 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Updating router 9a562b78-48b6-4a2c-9aec-0371a3e670cf port 84b73196-fb77-4c26-90a2-6d6283a3588e binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:27.987662 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] For port 8db29542-8539-45cf-9b02-17e5c43fec0b, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:27.993344 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] For port 8db29542-8539-45cf-9b02-17e5c43fec0b, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8db29542-8539-45cf-9b02-17e5c43fec0b,segment=NetworkSegment(89de1c6b-c41f-466f-9ac5-1885b681ff12),segment_id=89de1c6b-c41f-466f-9ac5-1885b681ff12)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:27.995139 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:28.043582 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:28.044709 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-25b059b4-2c74-4e71-9307-8ad3c4fe5c4b req-ebdcb067-b020-4f36-b682-adb2da96873a tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.0612662 Nov 18 21:02:28.079358 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35408) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:28.136593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fa8d526b-6537-4546-bb55-8582e5d0ef79 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:28.411726 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-c4bb2fd3-8ab1-4e06-be11-c8c94e15c3a2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:28.415557 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-c4bb2fd3-8ab1-4e06-be11-c8c94e15c3a2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "GET /v2.0/networks?id=114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 200 len: 808 time: 0.8107893 Nov 18 21:02:28.441139 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95e0c5df-92cd-4c73-9602-6678e286374b None None] Pushing event updated for resources: {'Port': ['ID=8db29542-8539-45cf-9b02-17e5c43fec0b,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:28.541628 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Request body: {'port': {'device_id': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab', 'admin_state_up': True, 'tenant_id': '851311932c184209baa31bf73923469b'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:28.586216 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5173fbb0-6f1b-4b59-81f8-a6355061f2ee req-c16c81a0-a61e-4d46-b6f5-1d7c724b78dc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.8058748 Nov 18 21:02:28.683414 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fa8d526b-6537-4546-bb55-8582e5d0ef79 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:28.694024 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fa8d526b-6537-4546-bb55-8582e5d0ef79 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:28.733633 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:28.824321 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa8d526b-6537-4546-bb55-8582e5d0ef79 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97b82822-7f8f-4ed6-b2fc-3797a133c12b,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:28.975341 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-fa8d526b-6537-4546-bb55-8582e5d0ef79 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=4beea28ae6d843cc9390f911ff3e89e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8937292 Nov 18 21:02:28.982266 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35420) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:29.180471 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2547f194-6456-43fe-ba92-746ffaa1c5c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.240569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Made reservation on behalf of 851311932c184209baa31bf73923469b for: {'port': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:29.246696 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.367590 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.380434 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.382886 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2547f194-6456-43fe-ba92-746ffaa1c5c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.398376 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1528d461-cc77-41db-989d-18fe94916e1a req-7b320ec7-4160-4d06-8712-eab04a2e07f8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.1340888 Nov 18 21:02:29.488781 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a1244db-c358-477b-aaca-20f6ac619112 req-f757a5f3-3bbb-490e-b767-0fd45a9a5be6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:29.521389 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3a1244db-c358-477b-aaca-20f6ac619112 req-f757a5f3-3bbb-490e-b767-0fd45a9a5be6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.3429837 Nov 18 21:02:29.822054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3a1244db-c358-477b-aaca-20f6ac619112 req-def3cbd0-1eec-4d2b-87cd-7ca32ef3d5b4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2990897 Nov 18 21:02:29.889727 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2547f194-6456-43fe-ba92-746ffaa1c5c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.905176 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2547f194-6456-43fe-ba92-746ffaa1c5c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:29.915924 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-2547f194-6456-43fe-ba92-746ffaa1c5c5 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/97b82822-7f8f-4ed6-b2fc-3797a133c12b HTTP/1.1" status: 204 len: 168 time: 0.9228747 Nov 18 21:02:29.978477 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2547f194-6456-43fe-ba92-746ffaa1c5c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97b82822-7f8f-4ed6-b2fc-3797a133c12b,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:30.092003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91df9f68-bb88-487e-b7c7-69d041c1106b None None] Pushing event updated for resources: {'Port': ['ID=84b73196-fb77-4c26-90a2-6d6283a3588e,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:30.409383 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Allocated IP 172.20.0.3 (114fdaf6-871a-4adc-a451-0c84b8e723ab/e48c8bc2-bbdc-434c-9eda-2ef0cb808732/4805fee1-0643-40f1-b07c-fd1f37af6ee7) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:30.426498 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Attempting to bind port 84b73196-fb77-4c26-90a2-6d6283a3588e on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:30.426939 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Attempting to bind port 84b73196-fb77-4c26-90a2-6d6283a3588e by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:30.427871 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Attempting to bind port 84b73196-fb77-4c26-90a2-6d6283a3588e on network 45e03d28-5c3b-481b-81f0-d332c4379a09 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:30.444094 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:30.444657 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Checking segment: {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:30.445142 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:30.445531 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Bound using segment: {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:30.446064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Bound port: 84b73196-fb77-4c26-90a2-6d6283a3588e, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'ad897c02-8041-447c-b198-6ec5aa961ad2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 618, 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:30.446624 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:30.467959 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-707bb1fd-b344-4d10-835e-63fd666fb02a None None] Provisioning complete for port 84b73196-fb77-4c26-90a2-6d6283a3588e triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:30.468429 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-707bb1fd-b344-4d10-835e-63fd666fb02a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:30.482079 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:30.545393 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-707bb1fd-b344-4d10-835e-63fd666fb02a None None] Port 84b73196-fb77-4c26-90a2-6d6283a3588e cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:30.547766 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48ebf6a4-2625-46c4-922b-a946aed2fb77 req-8732fb5f-14e9-4ddb-b520-b3a8105a3287 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:30.564759 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48ebf6a4-2625-46c4-922b-a946aed2fb77 req-8732fb5f-14e9-4ddb-b520-b3a8105a3287 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.3726559 Nov 18 21:02:30.575885 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-06a6010c-d690-46a2-acc6-bc53cb27dd11 req-4fb6b427-a577-480b-a2a0-d788e4e5de70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:30.581405 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-06a6010c-d690-46a2-acc6-bc53cb27dd11 req-4fb6b427-a577-480b-a2a0-d788e4e5de70 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 1099 time: 0.2567394 Nov 18 21:02:30.851196 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-06a6010c-d690-46a2-acc6-bc53cb27dd11 req-2141e818-b363-4dbc-b65c-e93b06ecc1b9 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2353549 Nov 18 21:02:31.008568 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48ebf6a4-2625-46c4-922b-a946aed2fb77 req-2f79c2a4-4d21-4465-bda6-22be42c47270 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4425147 Nov 18 21:02:31.060007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8db29542-8539-45cf-9b02-17e5c43fec0b up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:31.071111 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fd13712c-237a-4b89-9a90-17f5043255be None None] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:02:31.204089 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] For port 84b73196-fb77-4c26-90a2-6d6283a3588e, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:31.209744 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-45a5e22d-d201-4b29-a146-a7a5cfdc2e37 None None] Provisioning complete for port 8db29542-8539-45cf-9b02-17e5c43fec0b triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:31.210475 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-45a5e22d-d201-4b29-a146-a7a5cfdc2e37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:31.312386 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b239b02e-839e-429f-8038-ecb6a28fe417 req-5ba85955-9554-4582-8ac6-367d4695d382 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.5516047 Nov 18 21:02:31.346514 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] For port 84b73196-fb77-4c26-90a2-6d6283a3588e, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=84b73196-fb77-4c26-90a2-6d6283a3588e,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:31.388550 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979309a9-1453-46c5-a3ec-890c856bb8be req-0c94dd76-993b-485d-bf9d-bc840299699c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:31.390151 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-979309a9-1453-46c5-a3ec-890c856bb8be req-0c94dd76-993b-485d-bf9d-bc840299699c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1506581 Nov 18 21:02:31.447195 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:31.522634 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-979309a9-1453-46c5-a3ec-890c856bb8be req-8aa4b7c8-559f-41bb-955b-3fd430fc38cf tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1229231 Nov 18 21:02:31.690283 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:31.751747 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:31.835708 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Network 114fdaf6-871a-4adc-a451-0c84b8e723ab is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:31.842581 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:31.853919 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:31.904149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Routers {'9a562b78-48b6-4a2c-9aec-0371a3e670cf'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:31.904832 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:31.938435 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Pushing event updated for resources: {'Port': ['ID=4805fee1-0643-40f1-b07c-fd1f37af6ee7,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:31.967332 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Router 283e8f99-9b30-4e79-a84e-691b2bc0be7b is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102670) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:02:31.985095 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:31.985811 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.012810 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91df9f68-bb88-487e-b7c7-69d041c1106b None None] Pushing event updated for resources: {'Port': ['ID=84b73196-fb77-4c26-90a2-6d6283a3588e,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:32.020236 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-b2a9e35e-5058-4788-aaeb-a58288d252b2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 3.4976621 Nov 18 21:02:32.168816 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Request body: {'port': {'device_id': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:32.506296 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-78a88dcf-5844-41ae-8f10-9bf3ac12fc6d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.513654 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-45a5e22d-d201-4b29-a146-a7a5cfdc2e37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.572505 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5407f2f-80de-43e8-a647-f56bcccec6b8 req-24050ffb-c63e-4706-9ef6-2b84ccdcf960 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:32.590356 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e5407f2f-80de-43e8-a647-f56bcccec6b8 req-24050ffb-c63e-4706-9ef6-2b84ccdcf960 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.3351595 Nov 18 21:02:32.625030 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-45a5e22d-d201-4b29-a146-a7a5cfdc2e37 None None] For port 8db29542-8539-45cf-9b02-17e5c43fec0b, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8db29542-8539-45cf-9b02-17e5c43fec0b,segment=NetworkSegment(89de1c6b-c41f-466f-9ac5-1885b681ff12),segment_id=89de1c6b-c41f-466f-9ac5-1885b681ff12)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:32.692020 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.750868 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e5407f2f-80de-43e8-a647-f56bcccec6b8 req-b0409fd8-bbd4-4e10-8b9c-735f1eea0aec tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1530817 Nov 18 21:02:32.828682 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 8db29542-8539-45cf-9b02-17e5c43fec0b triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:32.829089 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.842689 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:32.843564 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-45a5e22d-d201-4b29-a146-a7a5cfdc2e37 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.858269 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Sync routers for ids ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:32.890988 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Routers {'283e8f99-9b30-4e79-a84e-691b2bc0be7b'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:32.899755 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:32.966918 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:32.975018 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35488) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:32.975391 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6e8a13a0-3cf9-4acb-8e9a-9b55249075ab admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 8.2570081 Nov 18 21:02:33.038709 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f11918a-0878-4588-9e14-af0dc2cf3a9c req-6f003ab1-28d7-473c-9462-d6709d6f0455 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:33.050347 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9f11918a-0878-4588-9e14-af0dc2cf3a9c req-6f003ab1-28d7-473c-9462-d6709d6f0455 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 931 time: 0.4199259 Nov 18 21:02:33.080359 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0db44081-6cd6-4e68-bc20-47451f7ed28f req-bad45961-2b06-4468-8c21-45ed84a7632b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:33.099757 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0db44081-6cd6-4e68-bc20-47451f7ed28f req-bad45961-2b06-4468-8c21-45ed84a7632b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.2017405 Nov 18 21:02:33.185807 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0db44081-6cd6-4e68-bc20-47451f7ed28f req-3755cd6c-f448-4c80-add5-4c1d7c45f3d4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842447 Nov 18 21:02:33.281825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] Set router 9a562b78-48b6-4a2c-9aec-0371a3e670cf gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:33.614011 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45a5e22d-d201-4b29-a146-a7a5cfdc2e37 None None] Pushing event updated for resources: {'Port': ['ID=8db29542-8539-45cf-9b02-17e5c43fec0b,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:33.630400 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Set router 283e8f99-9b30-4e79-a84e-691b2bc0be7b gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:33.733451 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9f11918a-0878-4588-9e14-af0dc2cf3a9c req-e35aac20-c719-492d-bd5d-da1e6e0efce2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6537747 Nov 18 21:02:33.803953 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-7ef9042b-f953-46c2-9983-b3c6a3ccc7a0 None None] Provisioning complete for port 84b73196-fb77-4c26-90a2-6d6283a3588e triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:33.804572 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7ef9042b-f953-46c2-9983-b3c6a3ccc7a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:33.985638 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35504) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:34.145486 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4805fee1-0643-40f1-b07c-fd1f37af6ee7 {{(pid=102670) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:02:34.160378 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:02:28Z', 'revision_number': 3, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:26Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:34.215884 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.285545 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Checking router: 283e8f99-9b30-4e79-a84e-691b2bc0be7b for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:34.285893 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Updating router 283e8f99-9b30-4e79-a84e-691b2bc0be7b port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:34.307884 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.provisioning_blocks [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Transition to ACTIVE for port object 4805fee1-0643-40f1-b07c-fd1f37af6ee7 will not be triggered until provisioned by entity L2. {{(pid=102670) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:02:34.326765 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.459954 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.464347 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298b768a-873e-41ac-ac5b-5a708415088e req-6341a46c-fe89-4600-a2af-b29950c8be85 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:34.473336 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298b768a-873e-41ac-ac5b-5a708415088e req-6341a46c-fe89-4600-a2af-b29950c8be85 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.1141682 Nov 18 21:02:34.576692 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.711315 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298b768a-873e-41ac-ac5b-5a708415088e req-41d829ee-39dd-4878-860b-844216f62c12 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2369425 Nov 18 21:02:34.751889 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7ef9042b-f953-46c2-9983-b3c6a3ccc7a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.767992 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Pushing event updated for resources: {'Port': ['ID=4805fee1-0643-40f1-b07c-fd1f37af6ee7,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:34.804930 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Attempting to bind port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:34.805455 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Attempting to bind port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:34.805943 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Attempting to bind port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 on network 114fdaf6-871a-4adc-a451-0c84b8e723ab {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:34.814896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 on network 114fdaf6-871a-4adc-a451-0c84b8e723ab not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:02:34.815435 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Attempting to bind port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 on network 114fdaf6-871a-4adc-a451-0c84b8e723ab {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:34.842970 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-83fe1ae2-d01f-4584-a083-dd40e94c5523 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.855027 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:34.860692 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Checking segment: {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:34.862769 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Bound using segment: {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:34.868803 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Bound port: 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'}}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:34.877235 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:34.918133 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9bcf2f6a-9bae-4dc4-ae85-723202182510 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.174584 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-7ef9042b-f953-46c2-9983-b3c6a3ccc7a0 None None] For port 84b73196-fb77-4c26-90a2-6d6283a3588e, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=84b73196-fb77-4c26-90a2-6d6283a3588e,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:35.190345 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8db29542-8539-45cf-9b02-17e5c43fec0b up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:35.201483 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:02:19Z', 'revision_number': 4, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '84b73196-fb77-4c26-90a2-6d6283a3588e', 'name': '', 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'mac_address': 'fa:16:3e:e6:34:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_interface', 'standard_attr_id': 318, 'fixed_ips': [{'subnet_id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:17Z', 'updated_at': '2021-11-18T21:02:31Z', 'revision_number': 4, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'subnets': [{'id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:35.259775 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-83fe1ae2-d01f-4584-a083-dd40e94c5523 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.276400 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Allocated IP 172.20.0.1 (48c3801d-f9ea-49b1-bf8f-8043491d206f/000d7d3c-2fa9-4900-aa84-42e72bfbb16b/ae3c0e28-7521-44dd-b940-2b4e1c1ace76) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:35.310341 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-83fe1ae2-d01f-4584-a083-dd40e94c5523 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.336727 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7ef9042b-f953-46c2-9983-b3c6a3ccc7a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.431210 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ef9042b-f953-46c2-9983-b3c6a3ccc7a0 None None] Pushing event updated for resources: {'Port': ['ID=84b73196-fb77-4c26-90a2-6d6283a3588e,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:35.437179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aa783730-a952-4285-947c-ddae1e1feb8e None None] The sync data for ids ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'] in dv-cinder-799871-8-iscsi is: [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:02:19Z', 'revision_number': 4, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '84b73196-fb77-4c26-90a2-6d6283a3588e', 'name': '', 'network_id': '45e03d28-5c3b-481b-81f0-d332c4379a09', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'mac_address': 'fa:16:3e:e6:34:35', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_interface', 'standard_attr_id': 318, 'fixed_ips': [{'subnet_id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:17Z', 'updated_at': '2021-11-18T21:02:31Z', 'revision_number': 4, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'subnets': [{'id': '07eef04b-f3f6-4ee0-b23d-7f9f86f27c94', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:35.495775 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.505446 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.533828 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-ce537010-da4a-4e69-a929-e8d8271f92ba None None] Provisioning complete for port 8db29542-8539-45cf-9b02-17e5c43fec0b triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:35.534634 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ce537010-da4a-4e69-a929-e8d8271f92ba None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.546942 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 8db29542-8539-45cf-9b02-17e5c43fec0b triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:35.547685 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.660431 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c66c91-0f55-424b-ab9d-18e6042dfc70 None None] Pushing event updated for resources: {'Port': ['ID=0a1f5c4d-24bf-459d-b08a-b93d56088c17,revision_number=2']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:35.698717 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Attempting to bind port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:35.700062 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Attempting to bind port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:35.703964 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Attempting to bind port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:35.717518 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:35.718638 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:35.719787 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.721985 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:35.725850 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Bound port: 0a1f5c4d-24bf-459d-b08a-b93d56088c17, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:35.726953 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:35.746588 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fe1ae2-d01f-4584-a083-dd40e94c5523 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a2a8c2f0-24b2-41e5-a49e-ee6e315c07a0,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:35.754137 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-83fe1ae2-d01f-4584-a083-dd40e94c5523 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=04506b4a4f7e4f30a307632700ef079d&name=default HTTP/1.1" status: 200 len: 2996 time: 1.7672641 Nov 18 21:02:35.780973 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35542) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:35.965788 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb3d5456-78fa-4830-863e-e2789232e6cc req-38badc22-e43d-4962-8172-2109bee9a5f1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:35.999334 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cb3d5456-78fa-4830-863e-e2789232e6cc req-38badc22-e43d-4962-8172-2109bee9a5f1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.7160656 Nov 18 21:02:36.005896 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] For port 0a1f5c4d-24bf-459d-b08a-b93d56088c17, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:36.029612 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] For port 0a1f5c4d-24bf-459d-b08a-b93d56088c17, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0a1f5c4d-24bf-459d-b08a-b93d56088c17,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:36.038948 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.105312 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] For port 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host hv-cinder-79987, cleared binding levels {{(pid=102670) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:36.124457 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.194144 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Routers {'283e8f99-9b30-4e79-a84e-691b2bc0be7b'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:36.195419 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:36.271541 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65c66c91-0f55-424b-ab9d-18e6042dfc70 None None] Pushing event updated for resources: {'Port': ['ID=0a1f5c4d-24bf-459d-b08a-b93d56088c17,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:36.510449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.524585 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cb3d5456-78fa-4830-863e-e2789232e6cc req-b165cd6d-35de-4da3-97f7-86513611fe52 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5224614 Nov 18 21:02:36.548784 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] For port 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102670) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:36.566657 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.570699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8bf5672-8781-475f-8689-f21d369dac4f req-70384bbc-605e-4d64-937a-d90244f32c18 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:36.580900 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b8bf5672-8781-475f-8689-f21d369dac4f req-70384bbc-605e-4d64-937a-d90244f32c18 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 943 time: 0.3794427 Nov 18 21:02:36.585471 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] Set router 283e8f99-9b30-4e79-a84e-691b2bc0be7b gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:36.720024 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b8bf5672-8781-475f-8689-f21d369dac4f req-7cdf8c2b-cf35-42f6-a2f6-2a2936dac767 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1381035 Nov 18 21:02:36.817089 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.845318 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-854e63a9-e158-47d7-9953-efff8f1a143a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.860076 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:36.872297 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:36.878327 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] 10.222.0.62 "PUT /v2.0/ports/4805fee1-0643-40f1-b07c-fd1f37af6ee7 HTTP/1.1" status: 200 len: 1093 time: 4.7281961 Nov 18 21:02:36.901686 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'tag': '4805fee1-0643-40f1-b07c-fd1f37af6ee7'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:02:36.915431 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b" -d '{"events": [{"name": "network-changed", "server_uuid": "95e35504-acfc-482a-8d61-ae1b6888cf7c", "tag": "4805fee1-0643-40f1-b07c-fd1f37af6ee7"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:02:36.944868 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Pushing event updated for resources: {'Port': ['ID=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:36.959859 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:36.961657 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:36.965448 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:37.055573 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 84b73196-fb77-4c26-90a2-6d6283a3588e up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:37.118874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.171098 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:02:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-96c189b3-5c95-47b8-98c6-9ec327915a54 x-openstack-request-id: req-96c189b3-5c95-47b8-98c6-9ec327915a54 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:02:37.171407 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "95e35504-acfc-482a-8d61-ae1b6888cf7c", "tag": "4805fee1-0643-40f1-b07c-fd1f37af6ee7", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:02:37.171652 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-96c189b3-5c95-47b8-98c6-9ec327915a54 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:02:37.172055 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'tag': '4805fee1-0643-40f1-b07c-fd1f37af6ee7', 'status': 'completed', 'code': 200} Nov 18 21:02:37.336823 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 84b73196-fb77-4c26-90a2-6d6283a3588e triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:37.339634 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.362674 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-854e63a9-e158-47d7-9953-efff8f1a143a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.380920 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d633e14-c6da-4ab0-a294-df9dd5f9e474 service neutron] Pushing event updated for resources: {'Port': ['ID=4805fee1-0643-40f1-b07c-fd1f37af6ee7,revision_number=3']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:37.523926 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.631536 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.656396 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-2244273a-611b-4138-b435-af822be1c435 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:37.666668 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-2244273a-611b-4138-b435-af822be1c435 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=851311932c184209baa31bf73923469b&device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 1096 time: 0.5892141 Nov 18 21:02:37.683327 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:02:28Z', 'revision_number': 3, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:37.690249 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-01a93a84-7fd0-4a28-9ba9-d4fad0ee1d18 None None] Provisioning complete for port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:37.690812 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-01a93a84-7fd0-4a28-9ba9-d4fad0ee1d18 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.739002 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-01a93a84-7fd0-4a28-9ba9-d4fad0ee1d18 None None] Port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:37.856975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-854e63a9-e158-47d7-9953-efff8f1a143a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.867832 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-854e63a9-e158-47d7-9953-efff8f1a143a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:37.874618 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-854e63a9-e158-47d7-9953-efff8f1a143a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a2a8c2f0-24b2-41e5-a49e-ee6e315c07a0 HTTP/1.1" status: 204 len: 168 time: 2.0918708 Nov 18 21:02:37.887771 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-fcd43a0e-5d65-4da6-978f-86ca0aed5076 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7 HTTP/1.1" status: 200 len: 217 time: 0.1918333 Nov 18 21:02:37.923705 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-854e63a9-e158-47d7-9953-efff8f1a143a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a2a8c2f0-24b2-41e5-a49e-ee6e315c07a0,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:38.174444 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ca8a499-6fec-4783-a741-9452b230d237 req-87ad44ae-ea3d-40d5-bf2a-dfa473b73b85 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:38.176247 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-87ad44ae-ea3d-40d5-bf2a-dfa473b73b85 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=e48c8bc2-bbdc-434c-9eda-2ef0cb808732 HTTP/1.1" status: 200 len: 848 time: 0.2722385 Nov 18 21:02:38.278704 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c37bc04c-b0be-4562-a37b-777ad3a99988 None None] The sync data for ids ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'] in dv-cinder-799871-8-iscsi is: [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:02:28Z', 'revision_number': 3, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:35Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:38.289781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:38.303523 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-4ae6f206-3286-41d9-8f78-a15cb2729255 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=114fdaf6-871a-4adc-a451-0c84b8e723ab&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1098547 Nov 18 21:02:38.424698 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4937658-c12a-411d-b1d8-ac65005527c4 req-4254b169-5395-43fc-a484-95078769e3a8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:38.434317 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c4937658-c12a-411d-b1d8-ac65005527c4 req-4254b169-5395-43fc-a484-95078769e3a8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 943 time: 0.4810524 Nov 18 21:02:38.588658 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-e00e485c-9a0a-43c8-9124-893564f3261f service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2671738 Nov 18 21:02:38.702960 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:38.723068 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:38.980195 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Pushing event updated for resources: {'Port': ['ID=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:38.987212 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35656) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:39.084450 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c4937658-c12a-411d-b1d8-ac65005527c4 req-a797170c-c8e4-426d-b42e-4b0cf1699ea7 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6481550 Nov 18 21:02:39.165938 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b9fec5d4-41a1-46f0-ba01-556e06f55b0d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:39.171564 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-97b55afc-da57-49f1-bb57-debc3617cffe tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:39.191587 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-97b55afc-da57-49f1-bb57-debc3617cffe tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.3917162 Nov 18 21:02:39.209054 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:39.300524 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-1c107265-75f6-489d-aae2-5360d2ddf5b9 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/quotas/05431e285025437d8783475290b4e4fc HTTP/1.1" status: 200 len: 375 time: 0.0749922 Nov 18 21:02:39.350977 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b9fec5d4-41a1-46f0-ba01-556e06f55b0d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:39.362763 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b9fec5d4-41a1-46f0-ba01-556e06f55b0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:39.401591 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9fec5d4-41a1-46f0-ba01-556e06f55b0d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a995c03d-5d77-47a9-976d-b6c376b6b305,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:39.495389 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ca8a499-6fec-4783-a741-9452b230d237 req-2456dc9d-ada4-4bd4-84ce-c9a988350313 service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.8884833 Nov 18 21:02:39.560036 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b9fec5d4-41a1-46f0-ba01-556e06f55b0d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e439589868474ba09258917c782ed437&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5113790 Nov 18 21:02:39.563694 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35668) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:39.587589 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-0d49c283-612b-4982-8e40-b61e28b8b5f0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&fields=id HTTP/1.1" status: 200 len: 302 time: 0.2506995 Nov 18 21:02:39.919341 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-8f4cd91d-3c8e-4ad2-8796-95d67f0a6e82 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:39.921769 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-8f4cd91d-3c8e-4ad2-8796-95d67f0a6e82 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=851311932c184209baa31bf73923469b&device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 1096 time: 0.2660127 Nov 18 21:02:39.933025 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:39.945202 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:40.214647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-18205384-1bb9-4372-8047-053e6ca91ebe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:40.217855 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-18205384-1bb9-4372-8047-053e6ca91ebe service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.4623609 Nov 18 21:02:40.218777 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-e7adf24e-a3cf-405a-a6ac-233479a335bb service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6121161 Nov 18 21:02:40.220743 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-eb411fb7-48dc-4a8a-aeea-fdd0f4f5ea06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:40.221991 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f995323b-5607-4db6-8829-ce2cce62ba89 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:40.224383 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-eb411fb7-48dc-4a8a-aeea-fdd0f4f5ea06 service neutron] 10.222.0.62 "GET /v2.0/networks?id=114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 200 len: 909 time: 0.2779417 Nov 18 21:02:40.236492 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35676) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:40.425367 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-6eb13b15-02cf-4120-9e91-5f4a40f3d43e service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7 HTTP/1.1" status: 200 len: 217 time: 0.1619253 Nov 18 21:02:40.545323 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-ba0a8bd2-a145-416f-954f-8fde9a7c4380 None None] Provisioning complete for port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:40.548212 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ba0a8bd2-a145-416f-954f-8fde9a7c4380 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:40.578682 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-14e5411e-3ba2-4fb0-9df2-6d65f8c881d8 service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3401005 Nov 18 21:02:40.603599 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-3bfa2129-019d-4526-a42d-726b6dad5c97 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:40.604975 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-3bfa2129-019d-4526-a42d-726b6dad5c97 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=e48c8bc2-bbdc-434c-9eda-2ef0cb808732 HTTP/1.1" status: 200 len: 848 time: 0.1612062 Nov 18 21:02:40.650913 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-dab8a1d3-cc62-4a0c-af48-36463e4da7bf service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=114fdaf6-871a-4adc-a451-0c84b8e723ab&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0323436 Nov 18 21:02:40.707583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4d292c02-1d12-4022-a0ee-4f11fb038a61 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:40.713104 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f995323b-5607-4db6-8829-ce2cce62ba89 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:40.721626 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-ba0a8bd2-a145-416f-954f-8fde9a7c4380 None None] Port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:02:40.829759 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Router 283e8f99-9b30-4e79-a84e-691b2bc0be7b has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:02:40.845826 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-507423ab-1bc3-4ded-9970-11021fa1233f service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1666555 Nov 18 21:02:40.874140 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1849c1d9-f034-4936-ba73-429b49e16115 req-9485c99b-7784-4940-bfb6-4740739546c4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:40.891796 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1849c1d9-f034-4936-ba73-429b49e16115 req-9485c99b-7784-4940-bfb6-4740739546c4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.6442995 Nov 18 21:02:41.059222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0a1f5c4d-24bf-459d-b08a-b93d56088c17 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:41.102941 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7e324a3-c7cb-4eec-8e60-5f2b7f9f3c8b req-1d71b755-3a59-4507-8a23-b208402fcebc service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2406893 Nov 18 21:02:41.180926 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c8c5a4-b5aa-42e8-8f31-9c9ae2b70b5a req-fdf60e55-fc6a-494e-a79d-629459e4651a tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:41.187611 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-16c8c5a4-b5aa-42e8-8f31-9c9ae2b70b5a req-fdf60e55-fc6a-494e-a79d-629459e4651a tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 943 time: 0.0912392 Nov 18 21:02:41.249593 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:41.250490 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:41.284189 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-16c8c5a4-b5aa-42e8-8f31-9c9ae2b70b5a req-93130613-8d6f-46e9-b465-2445e037d725 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0864766 Nov 18 21:02:41.368586 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6778a6bb-d33a-4d51-897a-267a84f3154e req-b0563a0e-784c-49eb-9632-78d71c6034b3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 210 time: 0.0422919 Nov 18 21:02:41.508419 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:02:41.582626 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:41.621913 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-bf966422-24b5-4c2d-9f93-2b1a09a0ce13 admin admin] 10.222.0.61 "PUT /v2.0/routers/283e8f99-9b30-4e79-a84e-691b2bc0be7b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 8.6424594 Nov 18 21:02:41.660912 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-eb469d2e-147e-4b87-b4fa-3d7f08ef9ded service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:41.663689 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-eb469d2e-147e-4b87-b4fa-3d7f08ef9ded service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 1.3780437 Nov 18 21:02:41.671618 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 0a1f5c4d-24bf-459d-b08a-b93d56088c17, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0a1f5c4d-24bf-459d-b08a-b93d56088c17,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:41.683760 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:41.710775 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1849c1d9-f034-4936-ba73-429b49e16115 req-f4736feb-84fe-42d1-834c-30103f81b592 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7796431 Nov 18 21:02:41.715207 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f995323b-5607-4db6-8829-ce2cce62ba89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:41.718048 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f995323b-5607-4db6-8829-ce2cce62ba89 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:41.724586 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f995323b-5607-4db6-8829-ce2cce62ba89 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a995c03d-5d77-47a9-976d-b6c376b6b305 HTTP/1.1" status: 204 len: 168 time: 2.1591160 Nov 18 21:02:41.783629 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Sync routers for ids ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:02:41.804667 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f995323b-5607-4db6-8829-ce2cce62ba89 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a995c03d-5d77-47a9-976d-b6c376b6b305,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:41.810229 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-bef39cf8-d1cf-4b76-96e5-b9cf42530690 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 217 time: 0.0979552 Nov 18 21:02:41.823706 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Routers {'283e8f99-9b30-4e79-a84e-691b2bc0be7b'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:41.824856 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:41.871180 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-595affe1-9400-4870-9984-e26983db5bea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:41.872807 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-595affe1-9400-4870-9984-e26983db5bea service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.0526617 Nov 18 21:02:41.963368 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=0a1f5c4d-24bf-459d-b08a-b93d56088c17,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:41.984808 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-65df6bf9-c77c-4452-b375-09a8db5af6e6 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0907621 Nov 18 21:02:42.097891 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Set router 283e8f99-9b30-4e79-a84e-691b2bc0be7b gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:42.203203 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-22cd965b-02d2-408b-b015-a79821cc32cf service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1916130 Nov 18 21:02:42.258939 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4d292c02-1d12-4022-a0ee-4f11fb038a61 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:42.417903 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22f9ef3f-17dd-45e4-938f-693f82d32e6b req-a03bb4d6-b69a-4128-890c-2ea2f4322606 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1898608 Nov 18 21:02:42.427619 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4d292c02-1d12-4022-a0ee-4f11fb038a61 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:42.571280 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-643bd456-5e58-45c2-bba7-d0bef9a9e83c req-b959a14b-50e4-4c7c-892a-93bc220028f4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:42.584213 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-643bd456-5e58-45c2-bba7-d0bef9a9e83c req-b959a14b-50e4-4c7c-892a-93bc220028f4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 943 time: 0.1632936 Nov 18 21:02:42.590843 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d292c02-1d12-4022-a0ee-4f11fb038a61 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=805a0032-b630-48cc-bae0-b35ea840f56e,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:42.712010 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-643bd456-5e58-45c2-bba7-d0bef9a9e83c req-d574a1ec-e66c-4706-b0cd-305207116891 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1233790 Nov 18 21:02:42.716377 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35716) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:42.717645 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-4d292c02-1d12-4022-a0ee-4f11fb038a61 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=579f9a68d74a4eb29de12a867a066b35&name=default HTTP/1.1" status: 200 len: 2996 time: 2.4596415 Nov 18 21:02:42.769713 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:02:42.827909 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4805fee1-0643-40f1-b07c-fd1f37af6ee7 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:02:42.860306 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c66e48-a887-4845-96cf-578fd7c4d710 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:42.921194 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c66e48-a887-4845-96cf-578fd7c4d710 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:42.999014 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a814b844-066f-4fa2-a618-af42d709bdf6 req-50d758be-96f0-4cbc-a6ac-8dc66ae26f24 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 210 time: 0.0522535 Nov 18 21:02:43.016700 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0a1f5c4d-24bf-459d-b08a-b93d56088c17 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:43.080396 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c66e48-a887-4845-96cf-578fd7c4d710 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:43.087061 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c66e48-a887-4845-96cf-578fd7c4d710 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:43.092845 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-23c66e48-a887-4845-96cf-578fd7c4d710 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/805a0032-b630-48cc-bae0-b35ea840f56e HTTP/1.1" status: 204 len: 168 time: 0.3712418 Nov 18 21:02:43.105167 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c66e48-a887-4845-96cf-578fd7c4d710 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=805a0032-b630-48cc-bae0-b35ea840f56e,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:43.159836 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.db.resource_extend [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] It took 0.16 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 18 21:02:43.455035 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:43.481919 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35732) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:43.506255 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-89532252', 'description': 'tempest-secgroup-smoke-89532252 description', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:43.592828 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:43.615670 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '4805fee1-0643-40f1-b07c-fd1f37af6ee7', 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab', 'port_id': '4805fee1-0643-40f1-b07c-fd1f37af6ee7', 'mac_address': 'fa:16:3e:9a:f5:8e', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 643, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e48c8bc2-bbdc-434c-9eda-2ef0cb808732', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:02:43.826666 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-420b2f34-fe07-4e62-be20-cb16dcd910ca req-e0e710df-4046-4b59-90a2-2cac684e5845 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:43.851339 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-420b2f34-fe07-4e62-be20-cb16dcd910ca req-e0e710df-4046-4b59-90a2-2cac684e5845 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2485020 Nov 18 21:02:43.931981 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.005332 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4805fee1-0643-40f1-b07c-fd1f37af6ee7 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:02:44.054443 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:44.075571 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.128666 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-420b2f34-fe07-4e62-be20-cb16dcd910ca req-3bde3c9f-0477-4fe5-9386-5e28ff638440 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2749751 Nov 18 21:02:44.219901 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35744) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:44.220149 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-9d338a0d-9627-44d9-8708-99f9d28195e0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:44.222964 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-9d338a0d-9627-44d9-8708-99f9d28195e0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.4535310 Nov 18 21:02:44.223251 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4805fee1-0643-40f1-b07c-fd1f37af6ee7,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:44.274107 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:02:37Z', 'revision_number': 4, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'ae3c0e28-7521-44dd-b940-2b4e1c1ace76', 'name': '', 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'mac_address': 'fa:16:3e:4f:00:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:34Z', 'updated_at': '2021-11-18T21:02:38Z', 'revision_number': 2, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'subnets': [{'id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:44.283276 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-90d58a6e-abf2-423c-99a5-0555505ee289 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.333393 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Request body: {'port': {'device_id': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'admin_state_up': True, 'tenant_id': '05431e285025437d8783475290b4e4fc'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:44.399306 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Checking router: 283e8f99-9b30-4e79-a84e-691b2bc0be7b for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:02:44.400023 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Updating router 283e8f99-9b30-4e79-a84e-691b2bc0be7b port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:02:44.461112 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.472740 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-90d58a6e-abf2-423c-99a5-0555505ee289 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.480721 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-90d58a6e-abf2-423c-99a5-0555505ee289 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.534791 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-90d58a6e-abf2-423c-99a5-0555505ee289 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=9aececfc6d8b43ea94c78dd94d133e13&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3127079 Nov 18 21:02:44.543815 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35756) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:44.592962 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-86f0d789-46fa-4bad-b94f-e822ae63bf7e req-438a6752-1de9-4594-80de-bc21fb653ec4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:44.613312 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-86f0d789-46fa-4bad-b94f-e822ae63bf7e req-438a6752-1de9-4594-80de-bc21fb653ec4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 944 time: 0.3879690 Nov 18 21:02:44.617787 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.649491 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-90d58a6e-abf2-423c-99a5-0555505ee289 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d505608-57fd-4061-b319-0867230f98be,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:44.671696 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7bb14425-adb7-4681-8b9c-630d8a2f12d4 req-0ad0b4bb-fdcc-4071-a959-bdc84631de8a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 210 time: 0.0542977 Nov 18 21:02:44.705997 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62f8206a-e1ab-4a8d-860a-4c647859cb81 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.757311 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62f8206a-e1ab-4a8d-860a-4c647859cb81 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.790580 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.796370 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['4805fee1-0643-40f1-b07c-fd1f37af6ee7'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:02:44.861789 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:44.862859 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.886748 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Made reservation on behalf of 05431e285025437d8783475290b4e4fc for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:44.899868 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.911795 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62f8206a-e1ab-4a8d-860a-4c647859cb81 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.915090 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62f8206a-e1ab-4a8d-860a-4c647859cb81 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.916352 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-62f8206a-e1ab-4a8d-860a-4c647859cb81 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/9d505608-57fd-4061-b319-0867230f98be HTTP/1.1" status: 204 len: 168 time: 0.3712301 Nov 18 21:02:44.921815 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:44.928882 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1807 time: 1.4428866 Nov 18 21:02:44.932017 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35762) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:44.934859 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f8931bd-1e22-4abe-8793-1d9f82863fa3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroup': ['ID=fbc78986-4204-4d3e-b1de-819272f7cec2,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:44.935575 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62f8206a-e1ab-4a8d-860a-4c647859cb81 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d505608-57fd-4061-b319-0867230f98be,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:44.953625 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group_rule': {'security_group_id': 'fbc78986-4204-4d3e-b1de-819272f7cec2', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:45.065393 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.137429 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Allocated IP 172.20.0.9 (2d6a6844-15e6-4a14-9103-24e890fa190f/fcebaf13-b181-404f-a8e5-52ddbe0c8c7c/d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:45.275302 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.281213 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.344963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-86f0d789-46fa-4bad-b94f-e822ae63bf7e req-a6929c53-8bc6-4471-a402-d3ed46356c46 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7307258 Nov 18 21:02:45.355920 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=732d8cf6-9614-4066-b2cb-8ca09e80775a,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:45.410960 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.415913 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-73a91200-2c1a-4ec0-8cb8-025d8e9033d2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4686401 Nov 18 21:02:45.421385 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35768) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:45.434207 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group_rule': {'security_group_id': 'fbc78986-4204-4d3e-b1de-819272f7cec2', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:45.484723 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.500279 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.506982 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36e20d46-66ce-4715-b6a0-96046bae9f62 req-cce4bf4b-1e72-4c78-905c-6c7e9ade1bca tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:45.517609 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-36e20d46-66ce-4715-b6a0-96046bae9f62 req-cce4bf4b-1e72-4c78-905c-6c7e9ade1bca tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1760681 Nov 18 21:02:45.647594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:45.694704 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-36e20d46-66ce-4715-b6a0-96046bae9f62 req-32592d4f-b303-4f2f-b714-8814a6461a4b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1759505 Nov 18 21:02:45.796810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event updated for resources: {'Port': ['ID=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:45.935057 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Network 2d6a6844-15e6-4a14-9103-24e890fa190f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:45.997526 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35780) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:46.035509 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.049038 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:46.122147 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:46.205594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.220386 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.234381 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.259129 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=102a595f-2ff7-4215-a9c1-bbc2e661c79a,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:46.311479 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:46.313032 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.361714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea841c4-eecc-4e40-9279-993ea1153fb8 None None] Pushing event updated for resources: {'Port': ['ID=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:46.374681 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.376771 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.383754 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3f179103-18f5-4247-9705-ffd21d95340e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.9599504 Nov 18 21:02:46.385506 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35788) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:46.423174 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1513cbb6-8b7c-437e-bffe-0b7788164cea req-c9b77090-1cd1-415b-b4ec-bdb9ab073765 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:46.437728 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1513cbb6-8b7c-437e-bffe-0b7788164cea req-c9b77090-1cd1-415b-b4ec-bdb9ab073765 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 931 time: 0.3814018 Nov 18 21:02:46.455264 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Attempting to bind port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:46.455648 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Attempting to bind port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:46.456196 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Attempting to bind port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 on network 48c3801d-f9ea-49b1-bf8f-8043491d206f {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:46.458065 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ba85b552-60f6-43c0-bceb-dcd1a64d9e48 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.1334920 Nov 18 21:02:46.467575 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Request body: {'port': {'device_id': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:46.481711 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:46.507847 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Checking segment: {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:46.523740 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.528999 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group_rule': {'security_group_id': 'fbc78986-4204-4d3e-b1de-819272f7cec2', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:46.530415 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Bound using segment: {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:46.530996 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Bound port: ae3c0e28-7521-44dd-b940-2b4e1c1ace76, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '89de1c6b-c41f-466f-9ac5-1885b681ff12', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 641, 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:46.531451 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.605381 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.616893 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.627744 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.725834 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] For port ae3c0e28-7521-44dd-b940-2b4e1c1ace76, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:46.739306 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] For port ae3c0e28-7521-44dd-b940-2b4e1c1ace76, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,segment=NetworkSegment(89de1c6b-c41f-466f-9ac5-1885b681ff12),segment_id=89de1c6b-c41f-466f-9ac5-1885b681ff12)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:46.746284 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:46.786392 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1513cbb6-8b7c-437e-bffe-0b7788164cea req-48e7c20b-e696-4862-afc4-b0da68c483eb tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2519941 Nov 18 21:02:46.809395 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=80f513544cda404cb80659de6549cf91&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8093600 Nov 18 21:02:46.821635 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 35802) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:46.919370 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77', '76221db7-7a26-4eba-b39a-1b8a36a04f16'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:02:46.946362 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Routers {'283e8f99-9b30-4e79-a84e-691b2bc0be7b'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:02:46.947424 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:02:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:46.960868 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.032460 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-25b33282-7aaa-46e0-93a5-28bd5c2902f1 None None] Provisioning complete for port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:47.032460 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-25b33282-7aaa-46e0-93a5-28bd5c2902f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.044879 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5884aef1-c3e0-4260-b478-2d9cef5b22de,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:47.380265 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eea841c4-eecc-4e40-9279-993ea1153fb8 None None] Pushing event updated for resources: {'Port': ['ID=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:47.397708 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-25b33282-7aaa-46e0-93a5-28bd5c2902f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.544913 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-25b33282-7aaa-46e0-93a5-28bd5c2902f1 None None] For port ae3c0e28-7521-44dd-b940-2b4e1c1ace76, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,segment=NetworkSegment(89de1c6b-c41f-466f-9ac5-1885b681ff12),segment_id=89de1c6b-c41f-466f-9ac5-1885b681ff12)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:47.629117 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-25b33282-7aaa-46e0-93a5-28bd5c2902f1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.634880 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.667510 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.742752 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.743309 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.743873 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.744490 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.745030 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.745588 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.746149 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.746727 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.747299 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.747843 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.748531 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.749121 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b042cbad-13b8-4779-9653-1b0e6aa368d5 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.750169 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a79e9f2-2185-4a92-a070-3b2d03609417 req-236a14be-61c2-4555-ace8-0bfdeb812f1a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:47.752878 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4a79e9f2-2185-4a92-a070-3b2d03609417 req-236a14be-61c2-4555-ace8-0bfdeb812f1a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.7493293 Nov 18 21:02:47.792630 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=03a7232e-62fc-4c65-8932-ab7ca99cd5b0,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:47.819890 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed152a8a-38e3-43c1-87eb-1bcb344c0359 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.832675 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fca90a43-cdb1-4b42-85e6-bc504d729c20 req-53c052db-f728-4aaa-bd5b-815593669305 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:47.834650 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fca90a43-cdb1-4b42-85e6-bc504d729c20 req-53c052db-f728-4aaa-bd5b-815593669305 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 944 time: 1.2272742 Nov 18 21:02:47.887815 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] Set router 283e8f99-9b30-4e79-a84e-691b2bc0be7b gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:02:47.908459 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-22ce6e0d-8f40-42fe-8845-09c7d4f65a72 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.9819784 Nov 18 21:02:47.927227 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.927834 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.928431 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.929140 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.929741 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.930306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.930875 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.931452 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.932004 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.932601 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.933175 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.933736 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:47.964441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.968805 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5b9f2623-494d-45b2-a344-bafc10e33df2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.4408343 Nov 18 21:02:47.977367 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed152a8a-38e3-43c1-87eb-1bcb344c0359 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:47.979290 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35820) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:47.987052 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group_rule': {'security_group_id': 'fbc78986-4204-4d3e-b1de-819272f7cec2', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:48.039440 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-25b33282-7aaa-46e0-93a5-28bd5c2902f1 None None] Pushing event updated for resources: {'Port': ['ID=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:48.133383 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4a79e9f2-2185-4a92-a070-3b2d03609417 req-ba723f10-fbb4-4c89-ae17-0e0a5ad5c3a7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2455952 Nov 18 21:02:48.165043 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:48.266118 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fca90a43-cdb1-4b42-85e6-bc504d729c20 req-cc2ea1c8-f005-4e6a-86ff-677389444288 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4147158 Nov 18 21:02:48.320493 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-b0f0f42e-9858-4f7f-8624-b26a48e94729 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:48.323586 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-b0f0f42e-9858-4f7f-8624-b26a48e94729 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 1098 time: 0.3503907 Nov 18 21:02:48.326645 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed152a8a-38e3-43c1-87eb-1bcb344c0359 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:48.339601 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ed152a8a-38e3-43c1-87eb-1bcb344c0359 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:48.345727 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ed152a8a-38e3-43c1-87eb-1bcb344c0359 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/5884aef1-c3e0-4260-b478-2d9cef5b22de HTTP/1.1" status: 204 len: 168 time: 1.5093720 Nov 18 21:02:48.384053 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed152a8a-38e3-43c1-87eb-1bcb344c0359 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5884aef1-c3e0-4260-b478-2d9cef5b22de,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:48.556333 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4805fee1-0643-40f1-b07c-fd1f37af6ee7 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:48.735720 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-923671e3-a849-4577-98bb-75c4d6a35fed service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:48.743756 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-923671e3-a849-4577-98bb-75c4d6a35fed service neutron] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 915 time: 0.3533509 Nov 18 21:02:48.831866 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-856b5ace-731e-4ae8-8240-096eb2b2f9e6 None None] Provisioning complete for port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:48.832328 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-856b5ace-731e-4ae8-8240-096eb2b2f9e6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.044324 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:02:37Z', 'revision_number': 4, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'ae3c0e28-7521-44dd-b940-2b4e1c1ace76', 'name': '', 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'mac_address': 'fa:16:3e:4f:00:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:34Z', 'updated_at': '2021-11-18T21:02:46Z', 'revision_number': 4, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'subnets': [{'id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:02:49.066918 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-50d1c925-d8e9-416f-8a71-8505e9432d40 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77 HTTP/1.1" status: 200 len: 217 time: 0.2847412 Nov 18 21:02:49.095287 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e15fb9c-1b90-42f3-a5e0-a27921fffcb0 None None] The sync data for ids ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'] in dv-cinder-799871-8-iscsi is: [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:02:37Z', 'revision_number': 4, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'ae3c0e28-7521-44dd-b940-2b4e1c1ace76', 'name': '', 'network_id': '48c3801d-f9ea-49b1-bf8f-8043491d206f', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'mac_address': 'fa:16:3e:4f:00:13', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_interface', 'standard_attr_id': 345, 'fixed_ips': [{'subnet_id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:34Z', 'updated_at': '2021-11-18T21:02:46Z', 'revision_number': 4, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'subnets': [{'id': '000d7d3c-2fa9-4900-aa84-42e72bfbb16b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:02:49.204521 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:02:49.234333 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:49.236793 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.332032 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aa78c3b-cbef-44b8-b21e-d0e61147607f req-18d0821a-f8d8-4901-b61e-b57bd4bf740b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:49.340794 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.343257 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4aa78c3b-cbef-44b8-b21e-d0e61147607f req-18d0821a-f8d8-4901-b61e-b57bd4bf740b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 931 time: 0.8903513 Nov 18 21:02:49.362217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.387121 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:02:49.423625 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-ef15ea68-cad0-4268-ace9-9148e84eef28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:49.426624 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-ef15ea68-cad0-4268-ace9-9148e84eef28 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.3444860 Nov 18 21:02:49.434300 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.445548 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 1.4647171 Nov 18 21:02:49.448081 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.456496 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35846) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:49.472245 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.487691 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group_rule': {'security_group_id': 'fbc78986-4204-4d3e-b1de-819272f7cec2', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:49.539743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d533541-eaa9-4544-a619-a6655f04b81e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e1b045b6-b642-4977-bc2e-95f394608505,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:49.543677 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-5b8388c8-a36e-4285-8954-61d69cf98100 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1034784 Nov 18 21:02:49.587026 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Transition to ACTIVE for port object d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:02:49.644922 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.688515 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.703183 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4aa78c3b-cbef-44b8-b21e-d0e61147607f req-32caaac9-61a3-4830-9777-f414dc57cfd1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3462155 Nov 18 21:02:49.808369 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4805fee1-0643-40f1-b07c-fd1f37af6ee7'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:02:49.815908 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b4153a54-4939-4c87-bf56-100867c2c679" -d '{"events": [{"server_uuid": "95e35504-acfc-482a-8d61-ae1b6888cf7c", "name": "network-vif-plugged", "status": "completed", "tag": "4805fee1-0643-40f1-b07c-fd1f37af6ee7"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:02:49.899268 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-c6bed4df-f036-420b-805e-f785d29fb1ad service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3366129 Nov 18 21:02:49.899490 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:49.915231 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:49.994134 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.securitygroups_db [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Project d0f1cb43ab064a5388db98bf6b8228fa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 21:02:50.022386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:50.065923 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device ae3c0e28-7521-44dd-b940-2b4e1c1ace76 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:02:50.082200 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0b326fa-7b1a-4b17-ab08-842c15219fea req-070fe0e9-2e6a-45ba-b6d1-52d7f5703ef3 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:50.085131 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a0b326fa-7b1a-4b17-ab08-842c15219fea req-070fe0e9-2e6a-45ba-b6d1-52d7f5703ef3 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.1122229 Nov 18 21:02:50.119572 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b602d42-0bb8-47b8-8f9f-c08975600eda req-1c13db93-b43d-4b7b-8659-97cd4f13f714 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:50.135392 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0b602d42-0bb8-47b8-8f9f-c08975600eda req-1c13db93-b43d-4b7b-8659-97cd4f13f714 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.6007242 Nov 18 21:02:50.171730 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Pushing event updated for resources: {'Port': ['ID=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:50.230567 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-10bd0e4e-9de9-4021-ad10-7693b06370ee req-cc10f6bb-5cec-405f-9453-934e35e10dcf service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3177013 Nov 18 21:02:50.329296 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4805fee1-0643-40f1-b07c-fd1f37af6ee7,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:50.378447 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a0b326fa-7b1a-4b17-ab08-842c15219fea req-130cc6c9-1844-4d9b-bf64-6cfa51ff8336 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2710655 Nov 18 21:02:50.387883 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:02:50.388852 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:50.571506 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:50.590322 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:50.668281 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f0bb9146-6054-4739-aae8-55d4e3d30608,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:50.714173 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0b602d42-0bb8-47b8-8f9f-c08975600eda req-af31e67c-35ae-45f2-b9bd-a9d9456b38b7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5745716 Nov 18 21:02:50.720938 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Attempting to bind port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:02:50.724172 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Attempting to bind port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:02:50.726224 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Attempting to bind port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:50.762102 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:50.769971 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1b9d10b9-b3db-46ea-a299-34eed9fe53c2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 1.3010206 Nov 18 21:02:50.772516 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 35872) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:02:50.813709 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'security_group_rule': {'security_group_id': 'fbc78986-4204-4d3e-b1de-819272f7cec2', 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:50.845673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 on network 2d6a6844-15e6-4a14-9103-24e890fa190f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:02:50.851193 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Attempting to bind port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:02:50.861296 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:02:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f2c8f957-4f7e-4917-a24a-e9bc97200a5c x-openstack-request-id: req-f2c8f957-4f7e-4917-a24a-e9bc97200a5c {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:02:50.862550 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95e35504-acfc-482a-8d61-ae1b6888cf7c", "name": "network-vif-plugged", "status": "completed", "tag": "4805fee1-0643-40f1-b07c-fd1f37af6ee7", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:02:50.863045 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f2c8f957-4f7e-4917-a24a-e9bc97200a5c {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:02:50.864335 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4805fee1-0643-40f1-b07c-fd1f37af6ee7', 'code': 200} Nov 18 21:02:50.893498 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:02:50.899964 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Checking segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:02:50.900341 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Bound using segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:02:50.900985 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Bound port: d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:02:50.901769 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.128322 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.securitygroups_db [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Project d0f1cb43ab064a5388db98bf6b8228fa added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 21:02:51.193210 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.430401 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49e6d5ab-873e-4f40-b972-a4c094abc3ab req-0521a3ee-2336-453b-9dc4-7e891f1133ef tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:51.432668 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-49e6d5ab-873e-4f40-b972-a4c094abc3ab req-0521a3ee-2336-453b-9dc4-7e891f1133ef tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 943 time: 0.4412053 Nov 18 21:02:51.434157 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384747e6-887a-44df-ab25-88fec9cd7d75 req-5d162a24-0891-4d97-bf9d-a3dc87500a3c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:51.438674 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-384747e6-887a-44df-ab25-88fec9cd7d75 req-5d162a24-0891-4d97-bf9d-a3dc87500a3c service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 1098 time: 0.0973544 Nov 18 21:02:51.482216 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.492828 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.541485 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] For port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:02:51.545239 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3d9e448-0dd7-48dc-b646-61aca6198434,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:51.597967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] For port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:02:51.615335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.626895 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.628773 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a32d22b1-4d13-4ba8-8f80-69e22fc8d758 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.8500149 Nov 18 21:02:51.699926 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:51.702242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:51.702821 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-384747e6-887a-44df-ab25-88fec9cd7d75 req-938dca82-940c-43e2-9f84-8c49ebc9c0a2 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2421024 Nov 18 21:02:51.703906 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] 10.222.0.62 "PUT /v2.0/ports/d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 HTTP/1.1" status: 200 len: 1093 time: 5.2449603 Nov 18 21:02:51.730110 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-49e6d5ab-873e-4f40-b972-a4c094abc3ab req-7266a70e-c26a-41d2-a8f5-17444ecc582e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2383637 Nov 18 21:02:51.736330 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'tag': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:02:51.753630 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-18132223-74dc-4d01-aa6a-2dce52721d6a" -d '{"events": [{"name": "network-changed", "server_uuid": "c14b2cb4-f569-4e39-995a-6e45368442d5", "tag": "d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:02:51.845520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b0dc67-dfce-4724-8148-39c08f80cf90 service neutron] Pushing event updated for resources: {'Port': ['ID=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:51.898835 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-95ee97bf-4fed-46e9-a5ce-1a073d911b45 req-36a7fb9d-ed2b-411d-95cf-5c369af3f400 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:51.913584 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-95ee97bf-4fed-46e9-a5ce-1a073d911b45 req-36a7fb9d-ed2b-411d-95cf-5c369af3f400 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.2875552 Nov 18 21:02:52.084496 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-95ee97bf-4fed-46e9-a5ce-1a073d911b45 req-b854b6e9-3b47-436a-91f6-869fff3c53e2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1584909 Nov 18 21:02:52.430813 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-606075d6-34eb-4219-b6fe-68a424f11e0f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:52.438040 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-606075d6-34eb-4219-b6fe-68a424f11e0f service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 1096 time: 0.3001657 Nov 18 21:02:52.440548 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:02:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6170b88-409a-45eb-99ed-1ea21af0d92c x-openstack-request-id: req-b6170b88-409a-45eb-99ed-1ea21af0d92c {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:02:52.446306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c14b2cb4-f569-4e39-995a-6e45368442d5", "tag": "d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:02:52.449163 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b6170b88-409a-45eb-99ed-1ea21af0d92c {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:02:52.449747 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'tag': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3', 'status': 'completed', 'code': 200} Nov 18 21:02:52.593221 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca7af1a-a0be-446a-aced-f87009ece981 req-7cde5fcf-9265-4aab-8b18-2449757cbbba tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:52.604637 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3ca7af1a-a0be-446a-aced-f87009ece981 req-7cde5fcf-9265-4aab-8b18-2449757cbbba tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1685896 Nov 18 21:02:52.612762 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-4ac3f52c-3da0-4ad7-93db-1f9f4af857d5 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 HTTP/1.1" status: 200 len: 217 time: 0.1537066 Nov 18 21:02:52.727176 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3ca7af1a-a0be-446a-aced-f87009ece981 req-ce638ee4-3923-406d-8a57-ceab6ca384d1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1201482 Nov 18 21:02:52.741785 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-88021424-6ef5-4874-add6-a360fc33844a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:52.743508 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-88021424-6ef5-4874-add6-a360fc33844a service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.1197627 Nov 18 21:02:52.810614 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-9ffa3169-efc9-43ed-bc39-290793c7e847 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0495746 Nov 18 21:02:53.006412 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8459a8f0-50ce-4dcb-9523-38f4547ff24a req-c0fabf3e-d918-47ce-8404-63435fb973cc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:53.021607 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8459a8f0-50ce-4dcb-9523-38f4547ff24a req-c0fabf3e-d918-47ce-8404-63435fb973cc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 943 time: 0.1784229 Nov 18 21:02:53.089308 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-f4506445-b537-46c7-9432-8616bc81d235 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2693040 Nov 18 21:02:53.187092 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8459a8f0-50ce-4dcb-9523-38f4547ff24a req-82d406fe-af74-4fb8-8c7e-019e5aae89a9 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1634066 Nov 18 21:02:53.283659 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a43602dd-e00b-4ffd-b476-c17860ade8c4 req-ad8b4a18-91c7-4bf2-b0ed-8e072b84ae36 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1799119 Nov 18 21:02:53.468808 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2d2bdd6-b3c5-4854-8e4b-a5d9449f0382 req-c986fab4-031e-4db3-a8ce-71c5f7e559de tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:53.480434 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f2d2bdd6-b3c5-4854-8e4b-a5d9449f0382 req-c986fab4-031e-4db3-a8ce-71c5f7e559de tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.1946483 Nov 18 21:02:53.565228 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-14dd358c-3af3-4374-a597-5b9519c62fc3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:53.570446 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-14dd358c-3af3-4374-a597-5b9519c62fc3 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 1096 time: 0.1515429 Nov 18 21:02:53.648263 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f2d2bdd6-b3c5-4854-8e4b-a5d9449f0382 req-a455aab3-8490-4f08-997b-d9089ddc698f tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1663458 Nov 18 21:02:53.869032 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-a1e14a6d-b874-44c0-8522-828e9292d42c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:53.886846 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-a1e14a6d-b874-44c0-8522-828e9292d42c service neutron] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 915 time: 0.3005180 Nov 18 21:02:53.962088 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca4213f9-02b7-48df-87a8-73be486d16d0 req-512315ed-97f7-4af9-a006-f2f6932599c0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:53.967717 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ca4213f9-02b7-48df-87a8-73be486d16d0 req-512315ed-97f7-4af9-a006-f2f6932599c0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0933681 Nov 18 21:02:54.036203 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-ffe5becc-6af8-444b-bc31-4eb8269966c2 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 HTTP/1.1" status: 200 len: 217 time: 0.1097658 Nov 18 21:02:54.140408 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3aa5643a-35ad-45b2-adc2-8291652734bb tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/networks?tenant_id=1bae44277cb14f78954b8d5cb5e72988&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1014049 Nov 18 21:02:54.149434 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ca4213f9-02b7-48df-87a8-73be486d16d0 req-b9279882-a94b-4020-b76a-620fc9ee58fe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1718099 Nov 18 21:02:54.428493 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-fccc1466-5fe8-4d6c-b147-ddc040a68087 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:54.436357 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-fccc1466-5fe8-4d6c-b147-ddc040a68087 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.2926946 Nov 18 21:02:54.789294 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4670f00-66f0-4e45-a19b-bcf8afea0fe2 req-3d2c662c-b6c4-408b-b759-de20d54520da tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:54.794158 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a4670f00-66f0-4e45-a19b-bcf8afea0fe2 req-3d2c662c-b6c4-408b-b759-de20d54520da tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 943 time: 0.2648790 Nov 18 21:02:54.894330 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-b8618979-6e0f-43aa-ad0e-8d82b805cb04 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4305305 Nov 18 21:02:54.957154 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a4670f00-66f0-4e45-a19b-bcf8afea0fe2 req-1fe301aa-6374-484f-b84f-66e6a76b171c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1332061 Nov 18 21:02:55.126821 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-df867df9-44af-45b7-b7d1-8966a77d0eaa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:55.128559 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-df867df9-44af-45b7-b7d1-8966a77d0eaa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.9872429 Nov 18 21:02:55.173897 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-b2e9eb3a-ad8e-4819-a33f-0c1025e69976 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/quotas/1bae44277cb14f78954b8d5cb5e72988 HTTP/1.1" status: 200 len: 375 time: 0.0264318 Nov 18 21:02:55.215040 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00e28196-8fd3-4a49-b6c3-87b3eefa874c req-af769841-b936-49fd-ab1e-6ef76c53e815 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:55.217640 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-00e28196-8fd3-4a49-b6c3-87b3eefa874c req-af769841-b936-49fd-ab1e-6ef76c53e815 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.1197813 Nov 18 21:02:55.232164 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-1eb2653d-9974-4bf2-97e3-550ae1f88382 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=1bae44277cb14f78954b8d5cb5e72988&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0484703 Nov 18 21:02:55.235812 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-d6cf20ef-7f92-4988-ab63-3a9aa6c13239 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3102694 Nov 18 21:02:55.350365 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-00e28196-8fd3-4a49-b6c3-87b3eefa874c req-344033b0-39b7-4f7d-81e4-8ec592492e37 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1217015 Nov 18 21:02:55.516150 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-18132223-74dc-4d01-aa6a-2dce52721d6a req-bf01bb24-98bb-4067-88e5-a34e744c0eb0 service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2648458 Nov 18 21:02:55.653074 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ecffa9b8-be84-43e7-a474-ecb9614f667f req-f687916e-ff31-4175-8650-b430d7f86c58 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 210 time: 0.0667996 Nov 18 21:02:55.668059 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd053dfa-72b8-4a21-bdfa-4f7f148e8d87 req-5884793a-f238-474e-8e66-1041e3ea8df6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:55.670165 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dd053dfa-72b8-4a21-bdfa-4f7f148e8d87 req-5884793a-f238-474e-8e66-1041e3ea8df6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0750580 Nov 18 21:02:55.768193 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dd053dfa-72b8-4a21-bdfa-4f7f148e8d87 req-2d7877fc-4ce0-47ce-8ed2-42dc748d6418 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788937 Nov 18 21:02:56.184247 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8b40dfe-60a0-4225-b9f7-c93276a74d9e req-ad89bac9-7c9c-47e5-a998-9493366ef9d1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:56.186361 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f8b40dfe-60a0-4225-b9f7-c93276a74d9e req-ad89bac9-7c9c-47e5-a998-9493366ef9d1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 943 time: 0.1203806 Nov 18 21:02:56.311693 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f8b40dfe-60a0-4225-b9f7-c93276a74d9e req-32d7c1d5-233b-4bb6-80d2-4a2e3531d5af tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070335 Nov 18 21:02:56.500447 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:02:56.871792 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:56.939680 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'port_id': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3', 'mac_address': 'fa:16:3e:b3:8d:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 604, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fcebaf13-b181-404f-a8e5-52ddbe0c8c7c', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:02:56.990606 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-29161b5f-1af6-4ec2-885f-50c35e243978 req-a820a486-d40c-4755-9846-e25b27e91c03 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 210 time: 0.0831251 Nov 18 21:02:57.038066 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:57.086395 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:02:57.131739 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:02:57.132012 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2e8e446-a256-424b-ae75-b129c0cc132f req-c9174114-e702-4ed3-a7cb-9b90a8149f3b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:57.137623 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:57.146184 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b2e8e446-a256-424b-ae75-b129c0cc132f req-c9174114-e702-4ed3-a7cb-9b90a8149f3b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1231620 Nov 18 21:02:57.215649 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf60db4-4e45-46f8-ae25-fd97e5383faf req-10375b20-2677-484d-ac69-e5859829dfe5 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:57.238705 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-eaf60db4-4e45-46f8-ae25-fd97e5383faf req-10375b20-2677-484d-ac69-e5859829dfe5 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.0986660 Nov 18 21:02:57.253536 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b2e8e446-a256-424b-ae75-b129c0cc132f req-569a0510-8576-44e5-b9ac-92d34da690f3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1036205 Nov 18 21:02:57.296369 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:57.307099 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.307765 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.308353 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.308818 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.309413 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.309861 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.310318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.310897 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.311359 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.311778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.312883 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.313435 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:02:57.337763 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-eaf60db4-4e45-46f8-ae25-fd97e5383faf req-40f45d97-2389-4ff5-9027-1b694e783751 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0968213 Nov 18 21:02:57.500937 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-daae50a0-5a6b-45ed-b884-06608277e78d req-5660bb4a-65b6-4cba-8444-50c7a7d9f770 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:57.502476 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-daae50a0-5a6b-45ed-b884-06608277e78d req-5660bb4a-65b6-4cba-8444-50c7a7d9f770 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 944 time: 0.0751905 Nov 18 21:02:57.594454 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-daae50a0-5a6b-45ed-b884-06608277e78d req-f447b562-0b27-4337-8081-8780f889d82c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0797043 Nov 18 21:02:57.745339 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:02:57.872627 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-8d886269-d82c-4991-9813-f360f8cdbed6 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.62 "GET /v2.0/networks?tenant_id=1bae44277cb14f78954b8d5cb5e72988&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0706398 Nov 18 21:02:58.191133 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-7bdb4b45-7f17-45d8-b1ce-b1e0f2eae291 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:58.193056 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-7bdb4b45-7f17-45d8-b1ce-b1e0f2eae291 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.3091924 Nov 18 21:02:58.246319 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Request body: {'port': {'device_id': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb', 'admin_state_up': True, 'tenant_id': '1bae44277cb14f78954b8d5cb5e72988'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:02:58.323529 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-d8abd2ca-b759-4536-a4cc-e6ac640f3756 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:58.325133 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-d8abd2ca-b759-4536-a4cc-e6ac640f3756 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 815 time: 0.2159715 Nov 18 21:02:58.371938 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-52bfc805-e695-4b4c-b280-4953e514af8d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/quotas/05d2b75b4995419da5138c25c602c16e HTTP/1.1" status: 200 len: 375 time: 0.0296490 Nov 18 21:02:58.541528 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-5d6e6442-8f76-4975-ac15-e03a1e83a7d1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1516438 Nov 18 21:02:58.557697 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Made reservation on behalf of 1bae44277cb14f78954b8d5cb5e72988 for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:02:58.564843 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:58.591312 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-09dc51c7-b806-4d4e-bb13-46edeb5fc45d req-bb670571-619b-495d-9c7e-f9b46a306700 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 210 time: 0.0559435 Nov 18 21:02:58.674515 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:58.735942 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18c19b91-d01e-4420-9701-4e7d4d63f4ec req-a8d70259-f556-46ca-b883-5f1e465ea63e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:58.739187 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-18c19b91-d01e-4420-9701-4e7d4d63f4ec req-a8d70259-f556-46ca-b883-5f1e465ea63e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0856657 Nov 18 21:02:58.775039 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-a1461374-6e6b-4bfc-8bab-547b403a8780 service neutron] 10.222.0.61 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2040393 Nov 18 21:02:58.836958 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-18c19b91-d01e-4420-9701-4e7d4d63f4ec req-c641490a-7b5d-4652-9bec-b07e847e9660 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0869598 Nov 18 21:02:58.961372 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:58.981886 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:59.024439 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f967c95-c31a-4372-b4f9-c293b8c053b2 req-718c5958-74e3-4587-8e01-b883b20739bd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:59.028857 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2f967c95-c31a-4372-b4f9-c293b8c053b2 req-718c5958-74e3-4587-8e01-b883b20739bd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.0796537 Nov 18 21:02:59.133132 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-7148ff0b-58ec-4bce-9f8e-9c60b7d49d33 service neutron] 10.222.0.61 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3366272 Nov 18 21:02:59.133920 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2f967c95-c31a-4372-b4f9-c293b8c053b2 req-94837af3-1888-448b-8e3a-77d94a138ec8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0934582 Nov 18 21:02:59.249730 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Pushing event updated for resources: {'SecurityGroup': ['ID=21e31e1c-e685-4f8e-ab5c-f14f102db6f3,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:02:59.288834 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Allocated IP 192.168.233.145 (386cda10-1308-4cee-8772-8fb3decbfacb/1928d678-7ced-4a10-b464-3501d4344ed0/1b0cf535-b83e-4422-af6f-57cc3b7cbd14) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:02:59.371843 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033003a5-1814-4c40-ab7b-2e91e1526272 req-7ae2a5a6-352a-40f5-9c81-2c86fe4ad5d7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:59.385978 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-033003a5-1814-4c40-ab7b-2e91e1526272 req-7ae2a5a6-352a-40f5-9c81-2c86fe4ad5d7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1295269 Nov 18 21:02:59.499075 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-033003a5-1814-4c40-ab7b-2e91e1526272 req-bc01a82d-2a35-4e7a-8cc8-f3b1ca5ec4f5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0974538 Nov 18 21:02:59.644025 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6eaed7a-97ac-4e8e-a2e1-32fdc1b15e0f req-17b84629-3ab4-422b-9d4a-0c8e75837292 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:02:59.652962 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6eaed7a-97ac-4e8e-a2e1-32fdc1b15e0f req-17b84629-3ab4-422b-9d4a-0c8e75837292 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 944 time: 0.1911623 Nov 18 21:02:59.679979 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-badf2cb9-a560-4d39-b629-150d91157736 req-0270a7c0-cd3c-4fdc-8d28-edeafabcdc7e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 210 time: 0.0752866 Nov 18 21:02:59.740962 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:59.752191 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6eaed7a-97ac-4e8e-a2e1-32fdc1b15e0f req-318cf714-a1d5-44f9-921d-253153aee8e6 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0981224 Nov 18 21:02:59.819770 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:02:59.907386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Network 386cda10-1308-4cee-8772-8fb3decbfacb is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:02:59.912057 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:02:59.919941 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:02:59.974721 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Pushing event updated for resources: {'Port': ['ID=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:00.009842 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16b16f2d-b11b-4bc4-b3e6-de4826fbf3c1 req-0f8a3ac1-61e5-4540-b4f0-1a955a94c9d3 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:00.017912 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-16b16f2d-b11b-4bc4-b3e6-de4826fbf3c1 req-0f8a3ac1-61e5-4540-b4f0-1a955a94c9d3 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 936 time: 0.2077913 Nov 18 21:03:00.020619 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:00.021206 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.055866 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63511250-3a7a-426a-8d64-0518de3a9950 req-211796f4-8ae7-46b6-8cca-0c0bc73c182d tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:00.058943 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-63511250-3a7a-426a-8d64-0518de3a9950 req-211796f4-8ae7-46b6-8cca-0c0bc73c182d tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.1925697 Nov 18 21:03:00.144377 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-3064d3e5-f679-4ca6-acac-dce1711b2699 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 1.9072351 Nov 18 21:03:00.173428 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-16b16f2d-b11b-4bc4-b3e6-de4826fbf3c1 req-b6ea6ecc-96a5-4ec9-8a43-f3932063a96c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1523166 Nov 18 21:03:00.179067 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Request body: {'port': {'device_id': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:00.269837 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978355ec-89e9-43f4-83c2-326e068ad61f req-e81132d0-24c7-4dd9-9afc-9dabff2e3bce tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:00.273293 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-978355ec-89e9-43f4-83c2-326e068ad61f req-e81132d0-24c7-4dd9-9afc-9dabff2e3bce tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2388813 Nov 18 21:03:00.375155 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Deleting port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:03:00.375667 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.388060 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9c9cdc1-3c90-4697-b8bb-605831be41df req-6ffc22e9-4a90-4bdf-aa05-3c75ae1c6ddc tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:00.389595 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a9c9cdc1-3c90-4697-b8bb-605831be41df req-6ffc22e9-4a90-4bdf-aa05-3c75ae1c6ddc tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 945 time: 0.0858631 Nov 18 21:03:00.409613 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.416061 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-d55a9a04-65e9-4351-8cf3-6b0ecb7f3acb None None] Provisioning complete for port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:00.417024 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d55a9a04-65e9-4351-8cf3-6b0ecb7f3acb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.435084 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-978355ec-89e9-43f4-83c2-326e068ad61f req-e3fdb02a-083d-4cc7-859a-4eb2caa8ac36 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1521380 Nov 18 21:03:00.505185 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-d55a9a04-65e9-4351-8cf3-6b0ecb7f3acb None None] Port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:03:00.569275 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:03:00.574736 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a9c9cdc1-3c90-4697-b8bb-605831be41df req-40bce399-e377-4c8b-89f6-277bef8055ef tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1379113 Nov 18 21:03:00.600312 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] For port 4805fee1-0643-40f1-b07c-fd1f37af6ee7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4805fee1-0643-40f1-b07c-fd1f37af6ee7,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:00.601101 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.626788 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Calling delete_port for 4805fee1-0643-40f1-b07c-fd1f37af6ee7 owned by compute:nova {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:03:00.680234 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:03:00.686817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:00.689333 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.832324 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44d7cd3e-043e-4935-9069-5cb9038bb7ee req-985af076-f516-4466-bd3c-3bfdaf9fdf6a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:00.832324 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-44d7cd3e-043e-4935-9069-5cb9038bb7ee req-985af076-f516-4466-bd3c-3bfdaf9fdf6a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1600571 Nov 18 21:03:00.856692 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.898998 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.907877 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:00.911750 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1d68bfeb-bcb3-426d-93ec-f580e89b36ef" -d '{"events": [{"server_uuid": "c14b2cb4-f569-4e39-995a-6e45368442d5", "name": "network-vif-plugged", "status": "completed", "tag": "d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:00.926928 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:00.934331 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:00.947575 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e1784139-7742-44ca-87d4-513691824469 req-b838aee0-0876-4ce7-b78a-29af74cd9ae6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 210 time: 0.1226370 Nov 18 21:03:00.954536 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-44d7cd3e-043e-4935-9069-5cb9038bb7ee req-e0db8be1-f19b-4037-a569-2bfc552de36b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0835545 Nov 18 21:03:01.005967 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Pushing event deleted for resources: {'Port': ['ID=4805fee1-0643-40f1-b07c-fd1f37af6ee7,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:01.045775 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:01.052460 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7fd11160-a0a1-4eaf-8b69-42d3213164a2 x-openstack-request-id: req-7fd11160-a0a1-4eaf-8b69-42d3213164a2 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:01.053354 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c14b2cb4-f569-4e39-995a-6e45368442d5", "name": "network-vif-plugged", "status": "completed", "tag": "d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:01.053767 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-7fd11160-a0a1-4eaf-8b69-42d3213164a2 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:01.054380 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3', 'code': 200} Nov 18 21:03:01.093410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:01.107694 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:01.109181 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] No DVR routers for this DVR port 4805fee1-0643-40f1-b07c-fd1f37af6ee7 on host hv-cinder-79987 {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:03:01.119348 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:01.124472 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-63511250-3a7a-426a-8d64-0518de3a9950 req-cec19022-eeaf-491a-a7f8-4c07d99fb076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "DELETE /v2.0/ports/4805fee1-0643-40f1-b07c-fd1f37af6ee7 HTTP/1.1" status: 204 len: 173 time: 1.0460930 Nov 18 21:03:01.124807 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'name': 'network-vif-deleted', 'tag': '4805fee1-0643-40f1-b07c-fd1f37af6ee7'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:01.132410 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e00ec18-710f-491f-89ee-e0fa12d0d855" -d '{"events": [{"server_uuid": "95e35504-acfc-482a-8d61-ae1b6888cf7c", "name": "network-vif-deleted", "tag": "4805fee1-0643-40f1-b07c-fd1f37af6ee7"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:01.154833 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Transition to ACTIVE for port object 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:03:01.162950 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:01.265648 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a778e91c-ca44-4e5e-b86a-d73fdcb27708 req-dcdb2eb1-f106-4d49-ad1c-fd21b960849e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:01.268096 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a778e91c-ca44-4e5e-b86a-d73fdcb27708 req-dcdb2eb1-f106-4d49-ad1c-fd21b960849e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1600072 Nov 18 21:03:01.270262 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc770419-754d-4377-850d-5606fbc739fc x-openstack-request-id: req-bc770419-754d-4377-850d-5606fbc739fc {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:01.270820 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "95e35504-acfc-482a-8d61-ae1b6888cf7c", "name": "network-vif-deleted", "tag": "4805fee1-0643-40f1-b07c-fd1f37af6ee7", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:01.271080 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-bc770419-754d-4377-850d-5606fbc739fc {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:01.271480 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '95e35504-acfc-482a-8d61-ae1b6888cf7c', 'name': 'network-vif-deleted', 'tag': '4805fee1-0643-40f1-b07c-fd1f37af6ee7', 'status': 'completed', 'code': 200} Nov 18 21:03:01.276512 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Pushing event updated for resources: {'Port': ['ID=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:01.364432 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Attempting to bind port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:03:01.364432 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Attempting to bind port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:03:01.364432 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Attempting to bind port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 on network 386cda10-1308-4cee-8772-8fb3decbfacb {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:01.383459 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 on network 386cda10-1308-4cee-8772-8fb3decbfacb not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:03:01.395257 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Attempting to bind port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 on network 386cda10-1308-4cee-8772-8fb3decbfacb {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:01.437820 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 2, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:03:01.438396 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Checking segment: {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:03:01.439115 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Bound using segment: {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:03:01.440545 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Bound port: 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '82745c4d-5ef9-430f-8b50-cf3a463c6b2c', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 648, 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:03:01.442011 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:01.453442 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a778e91c-ca44-4e5e-b86a-d73fdcb27708 req-2c67521f-d693-4e7d-ad45-fdafd6e76197 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1588807 Nov 18 21:03:01.919812 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c1824b6-71d5-44b9-9448-5607c668ee4b req-1d15aec4-7ed1-4c95-a5c0-cad36d08bed2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:01.925304 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4c1824b6-71d5-44b9-9448-5607c668ee4b req-1d15aec4-7ed1-4c95-a5c0-cad36d08bed2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1884151 Nov 18 21:03:01.942637 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-cd2dc02e-40c9-4492-804e-5a6fbd6917ff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:01.944947 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-cd2dc02e-40c9-4492-804e-5a6fbd6917ff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 815 time: 0.4855113 Nov 18 21:03:01.980160 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'port': {'device_id': '6b87386c-a173-427d-a5e7-e1eec028652f', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'admin_state_up': True, 'tenant_id': '05d2b75b4995419da5138c25c602c16e'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:02.062865 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] For port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:03:02.068434 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] For port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:03:02.083047 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68fb245a-bde2-4536-ba82-081067d38c72 req-1756d61c-f60c-4a91-94b5-d278307afc5d tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:02.090641 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-68fb245a-bde2-4536-ba82-081067d38c72 req-1756d61c-f60c-4a91-94b5-d278307afc5d tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.7095633 Nov 18 21:03:02.094695 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:02.105594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45713d66-b3be-4b10-9501-f0f3c6a872f6 req-3d5db298-d9bc-409c-b3d3-5a251f35e8e6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:02.107169 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45713d66-b3be-4b10-9501-f0f3c6a872f6 req-3d5db298-d9bc-409c-b3d3-5a251f35e8e6 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 1098 time: 0.1206601 Nov 18 21:03:02.138500 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4c1824b6-71d5-44b9-9448-5607c668ee4b req-e94934fb-2108-43e1-b380-85b879628f63 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1923785 Nov 18 21:03:02.212043 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:02.212203 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-822a89e2-9dbc-46ab-a2df-e569e67bf14c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:02.213783 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:02.217484 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] 10.222.0.62 "PUT /v2.0/ports/1b0cf535-b83e-4422-af6f-57cc3b7cbd14 HTTP/1.1" status: 200 len: 1098 time: 2.0552971 Nov 18 21:03:02.239702 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'tag': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:02.244626 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46" -d '{"events": [{"name": "network-changed", "server_uuid": "a9569b0a-76bd-408d-98f8-4e5b08e979ab", "tag": "1b0cf535-b83e-4422-af6f-57cc3b7cbd14"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:02.360231 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9dd1b37f-459e-4566-aded-0b36f12b0db9 req-43b51d4c-67b4-4cbd-91b3-2e99a8bc4dc4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=95e35504-acfc-482a-8d61-ae1b6888cf7c HTTP/1.1" status: 200 len: 210 time: 0.0967677 Nov 18 21:03:02.397037 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-68fb245a-bde2-4536-ba82-081067d38c72 req-ed5a2d54-5855-4e89-9598-10e71eae273f tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3051393 Nov 18 21:03:02.422540 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Made reservation on behalf of 05d2b75b4995419da5138c25c602c16e for: {'port': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:03:02.433664 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:02.521268 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa07c836-b77f-47aa-8c22-54c3e765819b service neutron] Pushing event updated for resources: {'Port': ['ID=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:02.557922 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4805fee1-0643-40f1-b07c-fd1f37af6ee7 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:03:02.577194 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45713d66-b3be-4b10-9501-f0f3c6a872f6 req-2bbb4a77-4e44-4765-8fdd-2cb203ad3178 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4083099 Nov 18 21:03:02.620062 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-7463911e-7458-466c-850b-a662436f938a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:02.624974 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-7463911e-7458-466c-850b-a662436f938a service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=1bae44277cb14f78954b8d5cb5e72988&device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 1101 time: 0.3104506 Nov 18 21:03:02.656198 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 4805fee1-0643-40f1-b07c-fd1f37af6ee7 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:03:02.656555 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4805fee1-0643-40f1-b07c-fd1f37af6ee7 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:03:02.733318 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f1efbe5-8867-4b5e-8f2f-21f1b0c70ce1 req-def04d08-1490-4f74-9ef4-a57d86cf400e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:02.744821 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83c37865-e367-4b0c-ae4e-d7b0abc7d152 req-f08d754b-fb6b-45b1-8267-0e19f467e119 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 210 time: 0.0629952 Nov 18 21:03:02.751262 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f1efbe5-8867-4b5e-8f2f-21f1b0c70ce1 req-def04d08-1490-4f74-9ef4-a57d86cf400e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1890059 Nov 18 21:03:02.821229 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-efb82ad9-4386-42bc-963f-b2f07b4fb82c x-openstack-request-id: req-efb82ad9-4386-42bc-963f-b2f07b4fb82c {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:02.821677 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a9569b0a-76bd-408d-98f8-4e5b08e979ab", "tag": "1b0cf535-b83e-4422-af6f-57cc3b7cbd14", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:02.822013 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-efb82ad9-4386-42bc-963f-b2f07b4fb82c {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:02.822703 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'tag': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14', 'status': 'completed', 'code': 200} Nov 18 21:03:02.876202 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Allocated IP 172.20.0.5 (d912b0f3-c291-4df9-ad87-83ebffd63dae/15d33670-10a1-4513-bd2b-7b0b1de2e25c/e439a92d-6b32-4acc-93a3-91c54d8ca660) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:03:02.877513 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f1efbe5-8867-4b5e-8f2f-21f1b0c70ce1 req-e3ad739f-7d76-44c0-9206-2be36c7b271b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1248398 Nov 18 21:03:02.947790 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-b75010bf-aa27-421b-bd97-17b65aa2756e service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14 HTTP/1.1" status: 200 len: 217 time: 0.0626376 Nov 18 21:03:03.049808 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-8c61e81c-a935-4c09-bfc9-9cadb5033c04 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:03.052794 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-8c61e81c-a935-4c09-bfc9-9cadb5033c04 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=1928d678-7ced-4a10-b464-3501d4344ed0 HTTP/1.1" status: 200 len: 843 time: 0.0854633 Nov 18 21:03:03.231055 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 36242) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:03.371293 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c14becb5-f36f-4856-ad8a-d50898b16b7e req-61c8b249-c247-4e7d-ac5a-068a390c064a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:03.398873 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c14becb5-f36f-4856-ad8a-d50898b16b7e req-61c8b249-c247-4e7d-ac5a-068a390c064a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.4001412 Nov 18 21:03:03.451931 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c8ade20-9295-4dc2-b657-519947bc89c3 req-539ba6c8-c9ff-4048-aa30-c4b8c7e726c8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:03.467271 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5c8ade20-9295-4dc2-b657-519947bc89c3 req-539ba6c8-c9ff-4048-aa30-c4b8c7e726c8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1693931 Nov 18 21:03:03.549140 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c14becb5-f36f-4856-ad8a-d50898b16b7e req-b86ae81e-c9b5-4809-aa84-8ec8b5394b88 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1488616 Nov 18 21:03:03.626930 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:03.639522 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5c8ade20-9295-4dc2-b657-519947bc89c3 req-9b055ce8-1bd4-441a-a5b9-3c9d44c10980 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1703770 Nov 18 21:03:03.650146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-97455e5c-9eb7-472b-81db-b295f7de295c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:03.766084 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:03.901584 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Network d912b0f3-c291-4df9-ad87-83ebffd63dae is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:03:03.934388 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-97455e5c-9eb7-472b-81db-b295f7de295c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:03.937527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:03:03.942616 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-97455e5c-9eb7-472b-81db-b295f7de295c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:03.945957 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:03:03.994230 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57866d45-a4fe-4749-9968-5742df8d4167 req-cddeac6c-15b9-4c27-b819-6c2751a44edc tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:04.003662 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-57866d45-a4fe-4749-9968-5742df8d4167 req-cddeac6c-15b9-4c27-b819-6c2751a44edc tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1199372 Nov 18 21:03:04.029938 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-97455e5c-9eb7-472b-81db-b295f7de295c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=92c0d51c-6e79-448d-98b6-5c76b573223b,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:04.048343 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-97455e5c-9eb7-472b-81db-b295f7de295c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=5a746dc5d73944a99cd913981e57e84f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.8160913 Nov 18 21:03:04.050879 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 36260) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:04.062233 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:04.117135 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:04.118069 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.119389 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-57866d45-a4fe-4749-9968-5742df8d4167 req-bcd70f46-f35f-43b4-be9b-1c9ac7702e7c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1130781 Nov 18 21:03:04.162120 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-19d81f1f-9a29-4ca2-8022-a6f334baf19c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.211665 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00c30be4-00e8-4c95-9edc-167cbe976caa req-783976d5-733f-48df-84c3-658d47d40647 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:04.216282 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-19d81f1f-9a29-4ca2-8022-a6f334baf19c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.221478 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-00c30be4-00e8-4c95-9edc-167cbe976caa req-783976d5-733f-48df-84c3-658d47d40647 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.3238788 Nov 18 21:03:04.259169 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-31bafaab-b05f-4f53-ae0e-c6382e1b5c85 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 2.2881131 Nov 18 21:03:04.321775 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-00c30be4-00e8-4c95-9edc-167cbe976caa req-c60bbe04-cc98-4651-8127-cbf20e53e9e4 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966585 Nov 18 21:03:04.334384 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-19d81f1f-9a29-4ca2-8022-a6f334baf19c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.342351 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-19d81f1f-9a29-4ca2-8022-a6f334baf19c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.347588 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-19d81f1f-9a29-4ca2-8022-a6f334baf19c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/92c0d51c-6e79-448d-98b6-5c76b573223b HTTP/1.1" status: 204 len: 168 time: 0.2920835 Nov 18 21:03:04.356092 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d81f1f-9a29-4ca2-8022-a6f334baf19c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=92c0d51c-6e79-448d-98b6-5c76b573223b,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:04.461801 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-838d1b57-4733-4b48-9cab-afd37381c6f9 None None] Provisioning complete for port e439a92d-6b32-4acc-93a3-91c54d8ca660 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:04.464944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-838d1b57-4733-4b48-9cab-afd37381c6f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.547605 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-838d1b57-4733-4b48-9cab-afd37381c6f9 None None] Port e439a92d-6b32-4acc-93a3-91c54d8ca660 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:03:04.589487 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c49bd7a-cd42-48a9-b290-d6e0b1b9b360 req-7535e572-df51-4b5f-ae91-438491594245 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:04.591077 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3c49bd7a-cd42-48a9-b290-d6e0b1b9b360 req-7535e572-df51-4b5f-ae91-438491594245 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1209452 Nov 18 21:03:04.640010 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-449b303c-facb-45fc-9c51-c80c3a82d339 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.690072 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3c49bd7a-cd42-48a9-b290-d6e0b1b9b360 req-2a0df7b2-e05e-484b-8426-1a1e30a6d79b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0862987 Nov 18 21:03:04.908365 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a343469a-0195-430d-9bdb-cdcb787e0f3c req-85f600f8-b44f-495c-9f34-411bf70af506 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:04.917108 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a343469a-0195-430d-9bdb-cdcb787e0f3c req-85f600f8-b44f-495c-9f34-411bf70af506 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1048081 Nov 18 21:03:04.962617 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 36276) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:04.988207 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0289b77e-c84e-4141-a514-9d561ac89409 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:04.994532 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a343469a-0195-430d-9bdb-cdcb787e0f3c req-271f7da8-7d6c-46f7-8148-2d58d697a660 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0740328 Nov 18 21:03:05.133020 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0289b77e-c84e-4141-a514-9d561ac89409 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:05.140689 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7825cc2-cf1c-4447-9c4d-9e0b834b2755 req-f3ca8421-71e6-4367-90b9-cf34f2acf2c5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:05.141222 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0289b77e-c84e-4141-a514-9d561ac89409 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:05.142176 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f7825cc2-cf1c-4447-9c4d-9e0b834b2755 req-f3ca8421-71e6-4367-90b9-cf34f2acf2c5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0745068 Nov 18 21:03:05.203446 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0289b77e-c84e-4141-a514-9d561ac89409 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14d7251c-b21c-443a-9465-c924b2edbbec,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:05.221624 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-0289b77e-c84e-4141-a514-9d561ac89409 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=463b11bf1f074db3b776a1e7177a5386&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2570493 Nov 18 21:03:05.229348 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 36280) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:05.241405 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f7825cc2-cf1c-4447-9c4d-9e0b834b2755 req-8308eb2f-c17e-4542-be29-da9b18d3fe4b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865304 Nov 18 21:03:05.306260 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5eae27e-c76c-4441-a5ab-1b09a397e9c5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:05.372364 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5eae27e-c76c-4441-a5ab-1b09a397e9c5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:05.469897 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3dfc1aa-3e5c-4f23-aac0-68dc7db9f54b req-2b28a65b-0661-4a93-9741-98d0d3445223 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:05.472770 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b3dfc1aa-3e5c-4f23-aac0-68dc7db9f54b req-2b28a65b-0661-4a93-9741-98d0d3445223 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1161070 Nov 18 21:03:05.510584 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5eae27e-c76c-4441-a5ab-1b09a397e9c5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:05.513763 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5eae27e-c76c-4441-a5ab-1b09a397e9c5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:05.515157 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-e5eae27e-c76c-4441-a5ab-1b09a397e9c5 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/14d7251c-b21c-443a-9465-c924b2edbbec HTTP/1.1" status: 204 len: 168 time: 0.2848215 Nov 18 21:03:05.537953 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5eae27e-c76c-4441-a5ab-1b09a397e9c5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14d7251c-b21c-443a-9465-c924b2edbbec,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:05.576611 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b3dfc1aa-3e5c-4f23-aac0-68dc7db9f54b req-c1b889df-ed20-4228-bf2d-1a327a16f3a8 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0933259 Nov 18 21:03:05.762511 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcad5d5b-262b-484c-a90e-fce3aee15cf4 req-6bd4e122-610d-4245-a0d6-bda7c4ff19ae tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:05.765225 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dcad5d5b-262b-484c-a90e-fce3aee15cf4 req-6bd4e122-610d-4245-a0d6-bda7c4ff19ae tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.1013412 Nov 18 21:03:05.868549 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dcad5d5b-262b-484c-a90e-fce3aee15cf4 req-b27754e2-f8a5-4b9a-bccf-fd0cab8cef38 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921080 Nov 18 21:03:05.993811 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.006166 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb54a1cb-4f74-4420-8cac-fa8b740e074f req-c67ee65b-f96a-4f45-8ebc-d8fd304b4573 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:06.007451 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cb54a1cb-4f74-4420-8cac-fa8b740e074f req-c67ee65b-f96a-4f45-8ebc-d8fd304b4573 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0759416 Nov 18 21:03:06.061187 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cb54a1cb-4f74-4420-8cac-fa8b740e074f req-a78fadb8-a897-4c9b-b43c-13cf138e74e6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0526760 Nov 18 21:03:06.134682 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 36294) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:06.152841 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-addd8adc-9225-4d10-a3a3-20da9f7a00b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.304400 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e6e389-352b-40cd-9d38-7d3f58765a2e req-98b9e68b-2c7e-4988-a1d7-9c2db2caef92 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:06.305769 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a4e6e389-352b-40cd-9d38-7d3f58765a2e req-98b9e68b-2c7e-4988-a1d7-9c2db2caef92 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1380005 Nov 18 21:03:06.353075 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-addd8adc-9225-4d10-a3a3-20da9f7a00b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.361978 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-addd8adc-9225-4d10-a3a3-20da9f7a00b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.420231 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a4e6e389-352b-40cd-9d38-7d3f58765a2e req-e096af99-15c5-4605-955c-7b08996d608e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1044238 Nov 18 21:03:06.437775 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-addd8adc-9225-4d10-a3a3-20da9f7a00b3 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=060ab8a77efe46e08a4a9dd28c511695&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2991209 Nov 18 21:03:06.437775 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-addd8adc-9225-4d10-a3a3-20da9f7a00b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=767aae54-de64-4005-8046-fc64f056ebeb,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:06.438221 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 36298) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:06.526441 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5a0db5c7-5d4a-4f2e-991b-3f393fcb8b75 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.584032 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5a0db5c7-5d4a-4f2e-991b-3f393fcb8b75 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.643891 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-911b1c92-3cce-417f-89f9-2c7afb05cc47 req-fd79c24e-5e06-4fea-b8f7-34db2dc87320 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:06.645979 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-911b1c92-3cce-417f-89f9-2c7afb05cc47 req-fd79c24e-5e06-4fea-b8f7-34db2dc87320 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1039121 Nov 18 21:03:06.714926 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5a0db5c7-5d4a-4f2e-991b-3f393fcb8b75 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.719442 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5a0db5c7-5d4a-4f2e-991b-3f393fcb8b75 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:06.721565 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-5a0db5c7-5d4a-4f2e-991b-3f393fcb8b75 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/767aae54-de64-4005-8046-fc64f056ebeb HTTP/1.1" status: 204 len: 168 time: 0.2820699 Nov 18 21:03:06.755797 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a0db5c7-5d4a-4f2e-991b-3f393fcb8b75 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=767aae54-de64-4005-8046-fc64f056ebeb,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:06.766966 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-911b1c92-3cce-417f-89f9-2c7afb05cc47 req-e097592c-4bc9-4afe-88b4-c434f981af76 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1121204 Nov 18 21:03:06.969722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f5b82e3-2162-42c7-9856-b944462c85fc req-0a656b65-7f65-461b-99a0-0d800873d688 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:06.971908 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0f5b82e3-2162-42c7-9856-b944462c85fc req-0a656b65-7f65-461b-99a0-0d800873d688 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0754139 Nov 18 21:03:07.049018 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0f5b82e3-2162-42c7-9856-b944462c85fc req-9d0fa6d4-477f-4d76-a80b-daa08813b0d4 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543864 Nov 18 21:03:07.215230 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9aa6fd14-7f66-412b-b477-ea80d78318e6 req-7046594c-0161-419c-bea5-5f04193e57c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:07.220846 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9aa6fd14-7f66-412b-b477-ea80d78318e6 req-7046594c-0161-419c-bea5-5f04193e57c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0949945 Nov 18 21:03:07.320321 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9aa6fd14-7f66-412b-b477-ea80d78318e6 req-9e98d219-ff21-40c2-b786-66fe1b2b6618 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940237 Nov 18 21:03:07.461433 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:07.486848 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4591e43d-d430-45c5-9ec2-363238279609 req-a74fe213-571b-42b7-9712-378a234f07f3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:07.488887 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4591e43d-d430-45c5-9ec2-363238279609 req-a74fe213-571b-42b7-9712-378a234f07f3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0810194 Nov 18 21:03:07.572481 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4591e43d-d430-45c5-9ec2-363238279609 req-caa2ca18-a4d5-4c91-8c6c-ab496e9be58f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0718207 Nov 18 21:03:07.737622 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aee2f8e-8edb-442b-ae53-621fd3c0d504 req-a9b24025-e0c2-4f72-b765-fdc83a000d37 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:07.745101 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2aee2f8e-8edb-442b-ae53-621fd3c0d504 req-a9b24025-e0c2-4f72-b765-fdc83a000d37 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1005919 Nov 18 21:03:07.836883 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2aee2f8e-8edb-442b-ae53-621fd3c0d504 req-4e21cad2-8f55-4b1d-b26a-617f7c4c519c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847709 Nov 18 21:03:07.985793 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef67d01f-6535-473d-a9f1-2139ac3823de req-fee7c74a-b675-488a-a85d-1797300e0890 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:07.987601 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ef67d01f-6535-473d-a9f1-2139ac3823de req-fee7c74a-b675-488a-a85d-1797300e0890 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0692737 Nov 18 21:03:08.058692 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ef67d01f-6535-473d-a9f1-2139ac3823de req-5eb62006-ec16-4ba5-9e09-319ad8511b91 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0634081 Nov 18 21:03:08.269615 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf74a6e-4f0b-461b-9711-ceb209704318 req-c73e3825-2bb8-4320-88e3-5821d61e047c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:08.272663 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eaf74a6e-4f0b-461b-9711-ceb209704318 req-c73e3825-2bb8-4320-88e3-5821d61e047c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0793874 Nov 18 21:03:08.276079 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:08.379921 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eaf74a6e-4f0b-461b-9711-ceb209704318 req-d75727f7-499a-419b-be89-e0b7c383f2f6 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0966763 Nov 18 21:03:08.534669 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd3831d0-55a6-4493-a85d-1460cd937e70 req-a5f33373-7461-4133-839f-c1f397399eda tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:08.536970 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dd3831d0-55a6-4493-a85d-1460cd937e70 req-a5f33373-7461-4133-839f-c1f397399eda tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0741863 Nov 18 21:03:08.653051 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dd3831d0-55a6-4493-a85d-1460cd937e70 req-41260f6f-69fe-4fe5-be35-a276f909188a tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0936797 Nov 18 21:03:08.832602 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58128e02-db40-4bc4-816a-1b209a93de0a req-375ac478-0e39-4b3b-b417-b7825f0226b3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:08.842288 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-58128e02-db40-4bc4-816a-1b209a93de0a req-375ac478-0e39-4b3b-b417-b7825f0226b3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0951376 Nov 18 21:03:08.909420 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-58128e02-db40-4bc4-816a-1b209a93de0a req-8eec6b75-6892-4fb5-8b40-51b9f0fb44e5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0594170 Nov 18 21:03:09.107970 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6f6308-f470-4279-9614-b183d7521b6a req-678840f0-b1ff-4bae-8fbb-bed2bcfe3ea8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:09.113040 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3b6f6308-f470-4279-9614-b183d7521b6a req-678840f0-b1ff-4bae-8fbb-bed2bcfe3ea8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0984187 Nov 18 21:03:09.182416 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3b6f6308-f470-4279-9614-b183d7521b6a req-77d33aef-1191-4d7f-91c9-938c416d43e0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567305 Nov 18 21:03:09.631037 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3232b6a-f1bc-432a-92c1-59dc714de62e req-5c9b3cb3-d73c-4ae8-bed9-26d6e3004a0e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:09.634420 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d3232b6a-f1bc-432a-92c1-59dc714de62e req-5c9b3cb3-d73c-4ae8-bed9-26d6e3004a0e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.3446183 Nov 18 21:03:09.725966 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d3232b6a-f1bc-432a-92c1-59dc714de62e req-a195eaab-bce3-48ca-abbf-99386a5ca63b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0772836 Nov 18 21:03:09.949925 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55c00c38-eeee-40c1-bfcc-da6587f1b6c9 req-5f55ed3a-aef6-435a-8188-5459768d7be1 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:09.951577 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-55c00c38-eeee-40c1-bfcc-da6587f1b6c9 req-5f55ed3a-aef6-435a-8188-5459768d7be1 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1110377 Nov 18 21:03:10.026947 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-55c00c38-eeee-40c1-bfcc-da6587f1b6c9 req-7b3a47ff-297b-4582-879c-9d172ac4a795 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645149 Nov 18 21:03:10.210721 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306e92d5-4efe-49ea-b25a-a3d063d00b29 req-5241769a-d99e-4269-abe0-fed17bcdb972 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:10.212712 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-306e92d5-4efe-49ea-b25a-a3d063d00b29 req-5241769a-d99e-4269-abe0-fed17bcdb972 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0803819 Nov 18 21:03:10.324164 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-306e92d5-4efe-49ea-b25a-a3d063d00b29 req-76414be8-3b9a-48d3-ac96-7b9a6a816752 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1017740 Nov 18 21:03:10.578529 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c2680a-ec6a-432e-b71c-aec1c7823c77 req-819a92c8-11ce-47c3-b17d-d2a155c539de tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:10.579980 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-68c2680a-ec6a-432e-b71c-aec1c7823c77 req-819a92c8-11ce-47c3-b17d-d2a155c539de tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1493835 Nov 18 21:03:10.674920 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-68c2680a-ec6a-432e-b71c-aec1c7823c77 req-477c4a86-1657-437b-b1bc-52a423e1ab79 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0803955 Nov 18 21:03:10.876931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79e4a3cf-72aa-402d-bc5e-efd1f1cc36f3 req-3750724e-1829-4ef4-9571-6e5133e32230 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:10.879625 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-79e4a3cf-72aa-402d-bc5e-efd1f1cc36f3 req-3750724e-1829-4ef4-9571-6e5133e32230 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0852203 Nov 18 21:03:10.960892 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-79e4a3cf-72aa-402d-bc5e-efd1f1cc36f3 req-975f37f6-67a0-4e72-9747-c01d1a0be6a0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0700209 Nov 18 21:03:11.150241 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e7fe5fc-1f26-476d-928e-fcb8affa2883 req-20a69827-a21d-4cf6-af70-da7c81140a83 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:11.153774 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e7fe5fc-1f26-476d-928e-fcb8affa2883 req-20a69827-a21d-4cf6-af70-da7c81140a83 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0835195 Nov 18 21:03:11.216785 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e7fe5fc-1f26-476d-928e-fcb8affa2883 req-8f4462b3-3df3-4da6-adb1-8aa2ea5dde39 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0528581 Nov 18 21:03:11.371229 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a25dd2-cf6f-4e16-b784-e6b7ea1e5b5e req-8514af73-d85c-435d-b81b-6c9722f545cf tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:11.372980 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d0a25dd2-cf6f-4e16-b784-e6b7ea1e5b5e req-8514af73-d85c-435d-b81b-6c9722f545cf tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0750828 Nov 18 21:03:11.449199 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d0a25dd2-cf6f-4e16-b784-e6b7ea1e5b5e req-873949c2-4d84-4522-861e-fafc6cc0c3c0 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638072 Nov 18 21:03:11.615934 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12b42fae-90de-48a6-a042-69ec3eb2d2e6 req-7f3ab986-c9e9-4fd8-9232-b6f3ba6c8e4e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:11.618313 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-12b42fae-90de-48a6-a042-69ec3eb2d2e6 req-7f3ab986-c9e9-4fd8-9232-b6f3ba6c8e4e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0752974 Nov 18 21:03:11.701189 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-12b42fae-90de-48a6-a042-69ec3eb2d2e6 req-517094bf-fced-40ff-9b90-189dfbc2c876 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0753965 Nov 18 21:03:11.917748 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c99888e3-6b7d-4b66-bf5a-31be2e44496a req-c7160f3a-3b88-41c8-bfa7-c35204b47eb4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:11.920336 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c99888e3-6b7d-4b66-bf5a-31be2e44496a req-c7160f3a-3b88-41c8-bfa7-c35204b47eb4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1017375 Nov 18 21:03:12.020314 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c99888e3-6b7d-4b66-bf5a-31be2e44496a req-a1479333-02c4-4f75-9aa5-c22b86f867ab tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0900948 Nov 18 21:03:12.197456 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf178e8f-99ba-41da-a17b-18f4851357af req-dc5d1d71-3e2c-4651-aaad-929577ad4aa5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:12.199305 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf178e8f-99ba-41da-a17b-18f4851357af req-dc5d1d71-3e2c-4651-aaad-929577ad4aa5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0823073 Nov 18 21:03:12.275763 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf178e8f-99ba-41da-a17b-18f4851357af req-e0179a61-a297-44c0-bfed-f47fcccbf487 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0637887 Nov 18 21:03:12.515255 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-162313a9-39c9-414a-a04f-65c54cc95273 req-d5439556-71ea-49bd-be32-1002c0419457 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:12.522110 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-162313a9-39c9-414a-a04f-65c54cc95273 req-d5439556-71ea-49bd-be32-1002c0419457 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1061580 Nov 18 21:03:12.633261 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-162313a9-39c9-414a-a04f-65c54cc95273 req-25ceafe6-518c-4625-b9d6-cf60ae6dce88 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0987411 Nov 18 21:03:12.838835 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-043eafad-446c-4530-9a83-59a0e8579d81 req-779bad3a-3fce-48e4-83f4-d49c73e64f8d tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:12.840490 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-043eafad-446c-4530-9a83-59a0e8579d81 req-779bad3a-3fce-48e4-83f4-d49c73e64f8d tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0868053 Nov 18 21:03:12.948091 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-043eafad-446c-4530-9a83-59a0e8579d81 req-7a7349f0-0ef0-40e7-8054-e9fb8acf3e93 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0961602 Nov 18 21:03:13.196805 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6263dc91-4ce6-4189-90fa-c24b3374cd07 req-cfe35ac0-b767-4046-b9a1-99a46be35589 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:13.198414 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6263dc91-4ce6-4189-90fa-c24b3374cd07 req-cfe35ac0-b767-4046-b9a1-99a46be35589 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0990467 Nov 18 21:03:13.282303 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6263dc91-4ce6-4189-90fa-c24b3374cd07 req-77f371aa-6cba-4210-9b50-6e6e02526e41 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766420 Nov 18 21:03:13.465560 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-72f430b5-77cc-4368-8789-4f02ac4ba7be req-4021bda1-bcbc-4e87-b387-33c4fa0fb49e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:13.482169 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-72f430b5-77cc-4368-8789-4f02ac4ba7be req-4021bda1-bcbc-4e87-b387-33c4fa0fb49e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0941322 Nov 18 21:03:13.550020 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-72f430b5-77cc-4368-8789-4f02ac4ba7be req-06736729-d045-4452-b6f6-0b20d8afef5d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0666420 Nov 18 21:03:13.752807 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdfcf65b-e81e-47ef-968d-321ac36ddcca req-6803e780-b55a-468d-9e60-555861de5a46 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:13.756551 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bdfcf65b-e81e-47ef-968d-321ac36ddcca req-6803e780-b55a-468d-9e60-555861de5a46 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0877259 Nov 18 21:03:13.865703 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bdfcf65b-e81e-47ef-968d-321ac36ddcca req-d209aaf9-92fe-420b-8266-e7b2f726055f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0950534 Nov 18 21:03:14.008723 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78321c5e-bfac-4030-ad24-ccd071ba66f7 req-63cf823e-8500-4fb8-be8d-7467dddb3b7f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:14.010622 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-78321c5e-bfac-4030-ad24-ccd071ba66f7 req-63cf823e-8500-4fb8-be8d-7467dddb3b7f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0782866 Nov 18 21:03:14.082796 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-78321c5e-bfac-4030-ad24-ccd071ba66f7 req-2f480937-871b-49e2-a051-5e3fd8bbc029 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0604060 Nov 18 21:03:14.225608 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61b84a5f-dff8-48e7-bd48-df3aae35f513 req-9f3057d5-d5cb-4e52-a239-68a37d38291c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:14.227868 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-61b84a5f-dff8-48e7-bd48-df3aae35f513 req-9f3057d5-d5cb-4e52-a239-68a37d38291c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0798583 Nov 18 21:03:14.322468 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-61b84a5f-dff8-48e7-bd48-df3aae35f513 req-b2f4c89f-db38-478a-aa5b-23a653968e0d tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0782809 Nov 18 21:03:14.546069 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b75ab421-2600-4819-a1a8-0b3ddee65c6c req-49fa1b97-3ec7-47d8-a91e-ea9b6feb2a82 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:14.555959 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b75ab421-2600-4819-a1a8-0b3ddee65c6c req-49fa1b97-3ec7-47d8-a91e-ea9b6feb2a82 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.1242092 Nov 18 21:03:14.643698 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b75ab421-2600-4819-a1a8-0b3ddee65c6c req-f231f6ff-1316-43ce-99fe-661fb84d45bf tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0865426 Nov 18 21:03:14.751028 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-b156ac02-a329-48ca-8ff4-305086eef6fc tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:14.785542 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-b156ac02-a329-48ca-8ff4-305086eef6fc tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/networks?id=114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 200 len: 808 time: 0.1981852 Nov 18 21:03:14.803637 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-19773f66-c307-4452-9dd1-e93a98f1b260 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/quotas/851311932c184209baa31bf73923469b HTTP/1.1" status: 200 len: 375 time: 0.0157094 Nov 18 21:03:14.866140 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aedf58b7-a7a7-495d-9a1a-6322f04b3556 req-53a04344-b65c-4272-94d2-ee19b9335d97 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:14.875197 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-aedf58b7-a7a7-495d-9a1a-6322f04b3556 req-53a04344-b65c-4272-94d2-ee19b9335d97 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0957322 Nov 18 21:03:14.884702 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-ccac291e-197c-4f46-9368-15bc7e5afa90 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=851311932c184209baa31bf73923469b&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0684104 Nov 18 21:03:14.973537 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-aedf58b7-a7a7-495d-9a1a-6322f04b3556 req-619b4d53-f02d-4ef8-83c9-975ca4457944 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0959115 Nov 18 21:03:15.067277 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-1c3d4a95-0626-4c7d-a39d-29a1a961bc52 service neutron] 10.222.0.61 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1736298 Nov 18 21:03:15.169418 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf2c811c-9475-4275-89c7-8a0c1c115b63 req-0ae100f2-94a6-43c3-bbc3-825e3c04defd tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:15.171208 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf2c811c-9475-4275-89c7-8a0c1c115b63 req-0ae100f2-94a6-43c3-bbc3-825e3c04defd tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0810955 Nov 18 21:03:15.265063 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf2c811c-9475-4275-89c7-8a0c1c115b63 req-9322fb18-8a22-4b0f-bf8d-f66c4dc3dced tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0805404 Nov 18 21:03:15.290307 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f6afe25d-20fa-4c70-9c07-922b85c413dc service neutron] 10.222.0.61 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2085867 Nov 18 21:03:15.412409 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4a223a5-61d0-452f-8ce1-73b53cf1e247 req-1c68ba83-6bf2-40f7-afe8-80d5476371ea tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:15.414235 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b4a223a5-61d0-452f-8ce1-73b53cf1e247 req-1c68ba83-6bf2-40f7-afe8-80d5476371ea tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0781245 Nov 18 21:03:15.523294 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b4a223a5-61d0-452f-8ce1-73b53cf1e247 req-2225581a-4ae6-48e3-a0b0-1f5a64e2524d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0999072 Nov 18 21:03:15.626376 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8030d39c-efd4-4967-8408-496dfd9688ec req-a4dcb766-57bd-4eb1-8f29-53f64fe7aaca tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:15.641074 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8030d39c-efd4-4967-8408-496dfd9688ec req-a4dcb766-57bd-4eb1-8f29-53f64fe7aaca tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1219344 Nov 18 21:03:15.711391 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9914c47e-3ecd-4aab-bf7d-a75472519718 req-3c967875-6042-47c4-a5a4-d6b670eef8b9 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.0620317 Nov 18 21:03:15.762110 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8030d39c-efd4-4967-8408-496dfd9688ec req-ed325fe4-3f4a-4b88-8448-c235502044b8 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1131940 Nov 18 21:03:15.919633 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-784e94de-6e6a-4a79-acf2-9b154086d985 req-4b684f6b-346f-41e6-8fbc-b7da0ac8110c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:15.930495 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-784e94de-6e6a-4a79-acf2-9b154086d985 req-4b684f6b-346f-41e6-8fbc-b7da0ac8110c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.1277454 Nov 18 21:03:16.004794 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-784e94de-6e6a-4a79-acf2-9b154086d985 req-cc570b13-4b5e-4426-a719-3b8ff0f9ae26 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0730793 Nov 18 21:03:16.237757 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-93eaa5ff-10b4-4739-bb3e-db0b84d676ae req-a678bba3-072c-4e27-af6e-754e7f08cf92 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:16.240162 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-93eaa5ff-10b4-4739-bb3e-db0b84d676ae req-a678bba3-072c-4e27-af6e-754e7f08cf92 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1410367 Nov 18 21:03:16.319959 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-93eaa5ff-10b4-4739-bb3e-db0b84d676ae req-8efdc322-f4ed-49ca-b18e-24c3548ad9bd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0699897 Nov 18 21:03:16.471935 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04a27349-5ec6-42ad-a047-53158f653a47 req-aae97091-4399-4b19-b168-de9b1af28905 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:16.484727 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-04a27349-5ec6-42ad-a047-53158f653a47 req-aae97091-4399-4b19-b168-de9b1af28905 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0885479 Nov 18 21:03:16.544379 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-04a27349-5ec6-42ad-a047-53158f653a47 req-8102ff5e-88ec-43f2-9bf7-7cce710f8d39 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580707 Nov 18 21:03:16.733899 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af472416-77c6-49f7-8c98-08cdaaedb0bb req-434f3ec3-7521-426e-94c6-d68a1f6a878b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:16.747385 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af472416-77c6-49f7-8c98-08cdaaedb0bb req-434f3ec3-7521-426e-94c6-d68a1f6a878b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1016505 Nov 18 21:03:16.850386 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4691b217-eedc-4766-ba6b-aa85d5b77d3e req-1e631fcd-f4f9-4163-b1a2-a50e94a25076 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.0617678 Nov 18 21:03:16.872762 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af472416-77c6-49f7-8c98-08cdaaedb0bb req-71205a63-123a-4221-8d5b-9617022d510c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1227958 Nov 18 21:03:17.020630 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f88af8d4-2575-47cf-bcaf-b3d04599d6f3 req-897c8c58-dc24-4a69-96fb-0b4af4648dd9 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:17.023347 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f88af8d4-2575-47cf-bcaf-b3d04599d6f3 req-897c8c58-dc24-4a69-96fb-0b4af4648dd9 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0773015 Nov 18 21:03:17.095388 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f88af8d4-2575-47cf-bcaf-b3d04599d6f3 req-4c1a2849-db7b-4a2d-afa8-ec99e9091412 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0617929 Nov 18 21:03:17.185187 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8efb5ad7-7a5c-4c93-a1f4-d5384132df11 req-dea012a1-f260-4b4e-904a-6c180b70a798 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:17.187392 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8efb5ad7-7a5c-4c93-a1f4-d5384132df11 req-dea012a1-f260-4b4e-904a-6c180b70a798 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0698411 Nov 18 21:03:17.255779 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8efb5ad7-7a5c-4c93-a1f4-d5384132df11 req-b67c0774-d193-4d85-9179-5c15cb2dca9b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598354 Nov 18 21:03:17.490823 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d8f9a5cc-ef5f-47c8-a3f0-849efb321773 req-514547c2-abc5-4b56-b679-96c8e28d0c6e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:17.492491 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d8f9a5cc-ef5f-47c8-a3f0-849efb321773 req-514547c2-abc5-4b56-b679-96c8e28d0c6e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0767469 Nov 18 21:03:17.572090 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d8f9a5cc-ef5f-47c8-a3f0-849efb321773 req-2eb7b912-f8d7-45f4-8ce0-527a761ec787 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0700977 Nov 18 21:03:17.719311 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-084effef-1a84-4655-b7bb-7761a720f0be req-60933414-d63b-4f87-842d-37a7f23708dc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:17.722191 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-084effef-1a84-4655-b7bb-7761a720f0be req-60933414-d63b-4f87-842d-37a7f23708dc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0786893 Nov 18 21:03:17.804237 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-084effef-1a84-4655-b7bb-7761a720f0be req-204e83dc-a351-45ad-b624-0a39765487a6 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0687015 Nov 18 21:03:17.988896 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-11fddffd-cbc3-49ce-b6d2-1780ee17f1bc req-a4a01fd6-102e-4b50-8917-8d14245b057c tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.0393715 Nov 18 21:03:18.100395 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c2398dc-6403-43c2-9711-ecfcb62772ba req-ff397e7f-500c-4810-a982-dfb748560f2b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:18.102098 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c2398dc-6403-43c2-9711-ecfcb62772ba req-ff397e7f-500c-4810-a982-dfb748560f2b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0722356 Nov 18 21:03:18.198797 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c2398dc-6403-43c2-9711-ecfcb62772ba req-5a1c9df9-34ae-47bb-85f4-f7064a70561e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0893564 Nov 18 21:03:18.273444 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 36558) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:18.276632 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce52a9a-fac0-4eeb-87cd-a16478816569 req-3c60250e-b6d8-418d-8c5f-1205d2e4c237 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:18.278257 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7ce52a9a-fac0-4eeb-87cd-a16478816569 req-3c60250e-b6d8-418d-8c5f-1205d2e4c237 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.0874264 Nov 18 21:03:18.348091 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7ce52a9a-fac0-4eeb-87cd-a16478816569 req-d2eee570-8637-4751-b190-98bb9344454a tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0586345 Nov 18 21:03:18.434325 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-997960b9-bedc-4a64-99ca-b2f9543ab7e7 req-0e9f6f14-9034-4959-b80d-4308807e5aa9 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:18.435933 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-997960b9-bedc-4a64-99ca-b2f9543ab7e7 req-0e9f6f14-9034-4959-b80d-4308807e5aa9 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 931 time: 0.0890303 Nov 18 21:03:18.450273 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f5e6ba77-1a47-474e-b281-04c897ca3ab0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.521582 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-997960b9-bedc-4a64-99ca-b2f9543ab7e7 req-29211e46-66a1-4264-8e7e-16e242bbfe18 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0777724 Nov 18 21:03:18.578330 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f5e6ba77-1a47-474e-b281-04c897ca3ab0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.587890 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f5e6ba77-1a47-474e-b281-04c897ca3ab0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.630678 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5e6ba77-1a47-474e-b281-04c897ca3ab0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b36aba1c-b258-4693-b8b5-a961b0ef6292,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:18.635338 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f5e6ba77-1a47-474e-b281-04c897ca3ab0 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=aa6d92941f814ecbb173f704e17850d8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3603928 Nov 18 21:03:18.638482 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 36566) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:18.699149 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d169d86-6945-4463-a2f6-a890b04fa54d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.748243 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d169d86-6945-4463-a2f6-a890b04fa54d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.757034 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb5906c4-367b-44f9-801a-8b95e82e2085 req-db38e756-8357-4b50-85b6-d1744de133ca tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:18.771423 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cb5906c4-367b-44f9-801a-8b95e82e2085 req-db38e756-8357-4b50-85b6-d1744de133ca tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0944028 Nov 18 21:03:18.811412 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-5a54d9d2-85cf-4f54-bd62-1825c8d5d108 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:18.813077 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-5a54d9d2-85cf-4f54-bd62-1825c8d5d108 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=386cda10-1308-4cee-8772-8fb3decbfacb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.1009686 Nov 18 21:03:18.814385 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Request body: {'port': {'device_id': '6b87386c-a173-427d-a5e7-e1eec028652f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:18.927483 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d169d86-6945-4463-a2f6-a890b04fa54d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.932796 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8d169d86-6945-4463-a2f6-a890b04fa54d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:18.938975 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8d169d86-6945-4463-a2f6-a890b04fa54d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/b36aba1c-b258-4693-b8b5-a961b0ef6292 HTTP/1.1" status: 204 len: 168 time: 0.2989731 Nov 18 21:03:18.945425 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cb5906c4-367b-44f9-801a-8b95e82e2085 req-7a35bd32-debb-4e84-9dcd-04e125a67928 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1711576 Nov 18 21:03:18.977867 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:19.083016 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d169d86-6945-4463-a2f6-a890b04fa54d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b36aba1c-b258-4693-b8b5-a961b0ef6292,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:19.220943 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-45d40e05-5c18-4c03-8aae-af3f292d6f9f service neutron] 10.222.0.62 "GET /v2.0/networks/386cda10-1308-4cee-8772-8fb3decbfacb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3605187 Nov 18 21:03:19.235375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c8ccc88-da90-4dd7-8313-496798436892 req-26be1f53-fe50-434b-a242-3920331bc619 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:19.237529 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c8ccc88-da90-4dd7-8313-496798436892 req-26be1f53-fe50-434b-a242-3920331bc619 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1915586 Nov 18 21:03:19.274508 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f7d09684-a93e-4c22-a605-fdc0201c721d req-213cc955-c78d-4725-9e56-6ada14b11c02 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.0664368 Nov 18 21:03:19.288897 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:19.433974 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7c8ccc88-da90-4dd7-8313-496798436892 req-e85fe274-79fc-41f1-a650-07ade9be3f30 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1818368 Nov 18 21:03:19.467086 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0eda2ad8-f963-419f-bbbe-e21b1b5eccba req-f77f69a0-d11e-494d-a634-ea34ede5dbf6 service neutron] 10.222.0.62 "GET /v2.0/networks/386cda10-1308-4cee-8772-8fb3decbfacb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2257061 Nov 18 21:03:19.574175 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008c5e5c-c996-417b-bebf-7425ff56ecae req-9757c56f-fb9f-43c0-a991-da74fec5b1dc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:19.576171 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-008c5e5c-c996-417b-bebf-7425ff56ecae req-9757c56f-fb9f-43c0-a991-da74fec5b1dc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1476860 Nov 18 21:03:19.602179 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 36586) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:19.648966 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d89d10d-eead-42d6-961d-c41b72730b33 req-a52349a9-5ea3-4c9d-8f86-9718b37517bf tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:19.650881 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2d89d10d-eead-42d6-961d-c41b72730b33 req-a52349a9-5ea3-4c9d-8f86-9718b37517bf tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1089599 Nov 18 21:03:19.658867 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-b452caa1-f82e-4b98-9aab-56a7413959e9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:19.661113 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-b452caa1-f82e-4b98-9aab-56a7413959e9 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=1bae44277cb14f78954b8d5cb5e72988&device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 1101 time: 0.0776098 Nov 18 21:03:19.672055 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8d410b29-ad00-4428-8770-4df5f94c3fa6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:19.710795 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e439a92d-6b32-4acc-93a3-91c54d8ca660 {{(pid=102670) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:19.729712 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:19.747302 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-008c5e5c-c996-417b-bebf-7425ff56ecae req-3fe02937-e779-4ce7-a25c-57df3825abf9 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1616080 Nov 18 21:03:19.762673 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.provisioning_blocks [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Transition to ACTIVE for port object e439a92d-6b32-4acc-93a3-91c54d8ca660 will not be triggered until provisioned by entity L2. {{(pid=102670) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:03:19.763713 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2d89d10d-eead-42d6-961d-c41b72730b33 req-d95c89e0-e7c5-4952-a487-79d40fc38208 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011255 Nov 18 21:03:19.774000 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:19.790378 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:03:19.833779 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-7b7710f1-8d41-4636-a29d-81e1ed356ac2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:19.836247 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-7b7710f1-8d41-4636-a29d-81e1ed356ac2 service neutron] 10.222.0.62 "GET /v2.0/networks?id=386cda10-1308-4cee-8772-8fb3decbfacb HTTP/1.1" status: 200 len: 870 time: 0.1495998 Nov 18 21:03:19.891959 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:19.910428 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-c440d3b0-4d6a-4fc4-b18d-8753704c1fdc service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.145&port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14 HTTP/1.1" status: 200 len: 217 time: 0.0627482 Nov 18 21:03:20.016886 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8d410b29-ad00-4428-8770-4df5f94c3fa6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.028395 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc9ac268-9ffb-4d5c-aaa1-d9b6baecaa4e req-828f2043-3e8b-43fd-a823-9fa4539b84c6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.036720 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fc9ac268-9ffb-4d5c-aaa1-d9b6baecaa4e req-828f2043-3e8b-43fd-a823-9fa4539b84c6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 943 time: 0.1833282 Nov 18 21:03:20.051476 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-8a79fd51-3be9-4b03-9f71-811fd1fd5a9c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.055434 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-8a79fd51-3be9-4b03-9f71-811fd1fd5a9c service neutron] 10.222.0.62 "GET /v2.0/subnets?id=1928d678-7ced-4a10-b464-3501d4344ed0 HTTP/1.1" status: 200 len: 843 time: 0.1284111 Nov 18 21:03:20.059028 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-8d410b29-ad00-4428-8770-4df5f94c3fa6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.184783 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Attempting to bind port e439a92d-6b32-4acc-93a3-91c54d8ca660 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:03:20.185192 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Attempting to bind port e439a92d-6b32-4acc-93a3-91c54d8ca660 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:03:20.185525 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Attempting to bind port e439a92d-6b32-4acc-93a3-91c54d8ca660 on network d912b0f3-c291-4df9-ad87-83ebffd63dae {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:20.201858 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-8d410b29-ad00-4428-8770-4df5f94c3fa6 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1c9ced69b92e4cf1a0ed529ad7eba689&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5872817 Nov 18 21:03:20.204192 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d410b29-ad00-4428-8770-4df5f94c3fa6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d2925c7-fdc5-4bc3-8db5-d799099401cf,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:20.207137 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 36592) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:20.213942 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Port e439a92d-6b32-4acc-93a3-91c54d8ca660 on network d912b0f3-c291-4df9-ad87-83ebffd63dae not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:03:20.214243 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Attempting to bind port e439a92d-6b32-4acc-93a3-91c54d8ca660 on network d912b0f3-c291-4df9-ad87-83ebffd63dae {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:20.227535 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fc9ac268-9ffb-4d5c-aaa1-d9b6baecaa4e req-cd8bdc57-92a8-47bd-81a8-278cd4ae7511 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1895828 Nov 18 21:03:20.247033 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 3, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:03:20.264994 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Checking segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:03:20.267058 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Bound using segment: {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'} {{(pid=102670) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:03:20.267978 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.managers [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Bound port: e439a92d-6b32-4acc-93a3-91c54d8ca660, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b1433240-d17a-40eb-99a6-9242910e08a2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 649, 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae'}}] {{(pid=102670) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:03:20.269116 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.330253 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-f23869fd-2132-47e1-b3e0-eeae9bcb6cd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.331887 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-f23869fd-2132-47e1-b3e0-eeae9bcb6cd6 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=386cda10-1308-4cee-8772-8fb3decbfacb&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.2589145 Nov 18 21:03:20.377112 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-330dfe4c-3318-4944-a901-6d50eed92378 req-2b41f42e-514a-4bfd-9ae0-9b16d3c8b438 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.380135 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-330dfe4c-3318-4944-a901-6d50eed92378 req-2b41f42e-514a-4bfd-9ae0-9b16d3c8b438 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.2344635 Nov 18 21:03:20.401511 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-528414f6-5622-4a65-b1cf-5ae6678f94f6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.533001 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-10220d43-bb20-4f21-b365-43d4fe4fb94c tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.536754 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-10220d43-bb20-4f21-b365-43d4fe4fb94c tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "GET /v2.0/networks?id=114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 200 len: 808 time: 0.3599980 Nov 18 21:03:20.541828 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-51a9beb5-60e0-4218-8605-62e1688c1606 req-25d63778-5a6a-418f-a6c7-b6d691ccf73b tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.1112561 Nov 18 21:03:20.549086 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-528414f6-5622-4a65-b1cf-5ae6678f94f6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.556585 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, cleared binding levels {{(pid=102670) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:03:20.579593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Request body: {'port': {'device_id': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab', 'admin_state_up': True, 'tenant_id': '851311932c184209baa31bf73923469b'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:20.605228 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102670) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:03:20.605378 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-330dfe4c-3318-4944-a901-6d50eed92378 req-e6799215-e15a-4e59-b5ab-389f4d2207be tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2057123 Nov 18 21:03:20.639572 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:03:20.643294 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.701736 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-b1a66261-9994-4547-9f8d-de63fe55259d service neutron] 10.222.0.62 "GET /v2.0/networks/386cda10-1308-4cee-8772-8fb3decbfacb?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3199644 Nov 18 21:03:20.720009 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=3']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:20.754867 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.755961 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.760002 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-ea170246-7ab1-4939-bf25-f6662bba3544 service neutron] 10.222.0.62 "PUT /v2.0/ports/e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 1093 time: 1.9552655 Nov 18 21:03:20.764152 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:20.772394 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-22d36a1f-8e03-434c-a919-3a9b2770953c" -d '{"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:20.900285 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-528414f6-5622-4a65-b1cf-5ae6678f94f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.904383 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-528414f6-5622-4a65-b1cf-5ae6678f94f6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.906530 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-528414f6-5622-4a65-b1cf-5ae6678f94f6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/5d2925c7-fdc5-4bc3-8db5-d799099401cf HTTP/1.1" status: 204 len: 168 time: 0.6977923 Nov 18 21:03:20.913122 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:20.931258 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-528414f6-5622-4a65-b1cf-5ae6678f94f6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d2925c7-fdc5-4bc3-8db5-d799099401cf,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:20.932858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '36578666-b0b7-4111-a019-33bc4c0ac780', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780', 'mac_address': 'fa:16:3e:1b:e2:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:03:20.992664 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:20.992925 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-581da255-17cc-40e1-afaa-76dedb22dd3c req-99d85033-f519-4767-ad7a-6b2a06999162 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:20.995092 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-581da255-17cc-40e1-afaa-76dedb22dd3c req-99d85033-f519-4767-ad7a-6b2a06999162 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1798930 Nov 18 21:03:21.005418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Made reservation on behalf of 851311932c184209baa31bf73923469b for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:03:21.010738 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:21.021558 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 36578666-b0b7-4111-a019-33bc4c0ac780 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:21.084640 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:21.098262 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:21.100099 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ebeb5d9c-ce98-434e-aff5-0b86112e5d46 req-cbeb498d-b8e2-43df-8d1d-164548ac3d08 service neutron] 10.222.0.62 "GET /v2.0/networks/386cda10-1308-4cee-8772-8fb3decbfacb?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3562658 Nov 18 21:03:21.200474 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-49cd5220-888a-4806-969f-ded8f239fc7f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:21.221430 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-49cd5220-888a-4806-969f-ded8f239fc7f service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1096 time: 0.2012534 Nov 18 21:03:21.230147 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d327461d-19ae-48da-b3c2-ceb06948c88d req-eb07b663-6577-4149-8bba-9ce12644726e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:21.239310 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-581da255-17cc-40e1-afaa-76dedb22dd3c req-c13ce26a-48ee-4735-a0d9-782da26bf548 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2354989 Nov 18 21:03:21.239751 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d327461d-19ae-48da-b3c2-ceb06948c88d req-eb07b663-6577-4149-8bba-9ce12644726e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2832348 Nov 18 21:03:21.274412 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=6']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:21.319475 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Allocated IP 172.20.0.14 (114fdaf6-871a-4adc-a451-0c84b8e723ab/e48c8bc2-bbdc-434c-9eda-2ef0cb808732/38d48d8e-6aab-43ea-b759-b7146853cbce) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:03:21.384971 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-f42712c4-694f-46fa-a1ab-49d9c2faec76 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 217 time: 0.1447039 Nov 18 21:03:21.387081 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c5da5d1-3a33-433f-85af-73f18a8f0895 x-openstack-request-id: req-3c5da5d1-3a33-433f-85af-73f18a8f0895 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:21.387636 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:21.388140 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-3c5da5d1-3a33-433f-85af-73f18a8f0895 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:21.388860 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'status': 'completed', 'code': 200} Nov 18 21:03:21.475708 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['36578666-b0b7-4111-a019-33bc4c0ac780'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:21.587745 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-f0e8662d-b6bf-4f61-a4f6-5653327c8663 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:21.590192 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-f0e8662d-b6bf-4f61-a4f6-5653327c8663 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.1804559 Nov 18 21:03:21.663205 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd19091-9fe8-4c72-81b3-08520cd66bbf req-feac856f-c43c-4790-8ee3-f39f83d03caa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:21.676629 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8fd19091-9fe8-4c72-81b3-08520cd66bbf req-feac856f-c43c-4790-8ee3-f39f83d03caa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1574810 Nov 18 21:03:21.705974 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:21.781492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-4b595940-3b87-4fcf-898a-62fe7081730b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:21.783248 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-4b595940-3b87-4fcf-898a-62fe7081730b service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1716537 Nov 18 21:03:21.799895 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8fd19091-9fe8-4c72-81b3-08520cd66bbf req-7af3be71-b50c-4288-b1ad-cd7178701fec tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1223347 Nov 18 21:03:21.876823 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d327461d-19ae-48da-b3c2-ceb06948c88d req-4fa755cf-d4a3-40c4-9a00-eb61db2a8697 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6359749 Nov 18 21:03:21.993917 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 36626) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:22.026408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f621e877-0b4d-401d-aaae-b1ed45711b7b admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.108084 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-902d3816-d0a2-4672-88ce-65ddb2d1abd7 req-2f93161c-97a7-457b-aa67-5ca0902124b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:22.109790 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-902d3816-d0a2-4672-88ce-65ddb2d1abd7 req-2f93161c-97a7-457b-aa67-5ca0902124b9 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.2257838 Nov 18 21:03:22.185805 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f1fe275-cf8e-4521-a03e-151d72b6c4ec req-57c1206b-f607-486b-b7e4-5041e332f80b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:22.190172 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.192829 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f1fe275-cf8e-4521-a03e-151d72b6c4ec req-57c1206b-f607-486b-b7e4-5041e332f80b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 943 time: 0.1773219 Nov 18 21:03:22.198320 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-977eda1e-d212-44d7-b4e0-fb414f9feabb service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3792920 Nov 18 21:03:22.268296 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-5fa46b1c-2240-450e-a61c-f50aa75bbcb9 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-89532252&fields=id&tenant_id=d0f1cb43ab064a5388db98bf6b8228fa HTTP/1.1" status: 200 len: 267 time: 0.1706984 Nov 18 21:03:22.291852 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f621e877-0b4d-401d-aaae-b1ed45711b7b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.328877 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f1fe275-cf8e-4521-a03e-151d72b6c4ec req-3c64563c-6a45-4001-a97c-f41d86101106 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1275375 Nov 18 21:03:22.329157 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f621e877-0b4d-401d-aaae-b1ed45711b7b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.352175 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Network 114fdaf6-871a-4adc-a451-0c84b8e723ab is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:03:22.376620 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cde979f0-0817-4d05-a9df-b0d61bf121bc req-2179472b-90f0-467e-81ec-afff1bfa5481 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1540043 Nov 18 21:03:22.404804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:03:22.432161 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-902d3816-d0a2-4672-88ce-65ddb2d1abd7 req-0aa3fb85-35ac-409c-ba9e-090610298079 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2984650 Nov 18 21:03:22.441602 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:03:22.445249 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Pushing event updated for resources: {'Port': ['ID=38d48d8e-6aab-43ea-b759-b7146853cbce,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:22.529039 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f621e877-0b4d-401d-aaae-b1ed45711b7b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9327592d-ec38-479e-bd68-bb47302d8b7c,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:22.536002 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e79d4e5-97f7-4132-b8d9-eb3f9b811879 req-6e5ea2fc-f72a-4a70-9de2-2cf0f538e294 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:22.538588 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4e79d4e5-97f7-4132-b8d9-eb3f9b811879 req-6e5ea2fc-f72a-4a70-9de2-2cf0f538e294 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 932 time: 0.0820899 Nov 18 21:03:22.542901 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f621e877-0b4d-401d-aaae-b1ed45711b7b admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=9e081efcb8454a8ca359794e2e765336&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5454931 Nov 18 21:03:22.548845 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 36634) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:22.579026 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:22.579907 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.612244 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-946af850-222c-429d-a1c9-40c0f48196dd tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:22.614477 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-946af850-222c-429d-a1c9-40c0f48196dd tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 809 time: 0.3316875 Nov 18 21:03:22.623998 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-033d2371-e44e-4b52-9405-f28030f0aefd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.0558515 Nov 18 21:03:22.634202 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-ef8149b2-5323-43b2-ae33-9202f882b971 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/quotas/d0f1cb43ab064a5388db98bf6b8228fa HTTP/1.1" status: 200 len: 375 time: 0.0091696 Nov 18 21:03:22.643859 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:03:22.663300 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4e79d4e5-97f7-4132-b8d9-eb3f9b811879 req-2d275fee-e025-48c4-a955-2b4b3173cdd8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086428 Nov 18 21:03:22.665908 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:03:22.703974 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ccd1c8b8-d537-42d3-a060-b0dbf9b98172 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.728043 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-8686d035-3ad7-41d7-a300-21d6daf44bef tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0841942 Nov 18 21:03:22.765977 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ccd1c8b8-d537-42d3-a060-b0dbf9b98172 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.849218 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 36578666-b0b7-4111-a019-33bc4c0ac780 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:22.849940 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.900932 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bc879a57-9f94-41c5-be63-91eae3ba1b19 service neutron] 10.222.0.61 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1486440 Nov 18 21:03:22.912603 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Request body: {'port': {'device_id': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:22.936373 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bbe707b1-6ec0-4cf8-a917-4a84e67d6a4f req-dcc9199a-b99d-446d-aedf-740036c6913f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:22.949867 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bbe707b1-6ec0-4cf8-a917-4a84e67d6a4f req-dcc9199a-b99d-446d-aedf-740036c6913f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.1297288 Nov 18 21:03:22.981492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ccd1c8b8-d537-42d3-a060-b0dbf9b98172 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.986746 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ccd1c8b8-d537-42d3-a060-b0dbf9b98172 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:22.990147 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ccd1c8b8-d537-42d3-a060-b0dbf9b98172 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/9327592d-ec38-479e-bd68-bb47302d8b7c HTTP/1.1" status: 204 len: 168 time: 0.4363935 Nov 18 21:03:22.997560 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:23.008148 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ccd1c8b8-d537-42d3-a060-b0dbf9b98172 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9327592d-ec38-479e-bd68-bb47302d8b7c,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:23.043518 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14', 'network_id': '386cda10-1308-4cee-8772-8fb3decbfacb', 'port_id': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14', 'mac_address': 'fa:16:3e:24:fa:f7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 648, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '1928d678-7ced-4a10-b464-3501d4344ed0', 'ip_address': '192.168.233.145'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:03:23.045366 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:23.095044 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bbe707b1-6ec0-4cf8-a917-4a84e67d6a4f req-e47ef1ed-45f0-4f6b-90d3-bbcbba81fa31 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1427617 Nov 18 21:03:23.169176 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:23.178794 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-35a441c5-aaed-49e3-bfc4-901f3a183146" -d '{"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:23.204705 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:23.213463 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:23.216704 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-3fa252ac-e82d-4a2a-b76c-a76cf20aae06 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:23.218647 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:23.223845 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-3fa252ac-e82d-4a2a-b76c-a76cf20aae06 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1096 time: 0.3199623 Nov 18 21:03:23.240101 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-b8ef988e-70e4-47bb-acac-05b77535018e service neutron] 10.222.0.61 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3085167 Nov 18 21:03:23.260693 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:23.304592 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:23.352851 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bc19825-d830-4edf-9551-62b2ae37e006 req-d9e7257e-c2d5-4062-974c-1b596d581904 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:23.355433 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0bc19825-d830-4edf-9551-62b2ae37e006 req-d9e7257e-c2d5-4062-974c-1b596d581904 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 948 time: 0.1387219 Nov 18 21:03:23.430138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:23.435364 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=7']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:23.440579 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:23.521840 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0bc19825-d830-4edf-9551-62b2ae37e006 req-11f55d66-2992-4614-84d6-77bb9bf889d9 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1503692 Nov 18 21:03:23.533425 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-7367d476-69e6-49c1-9480-865cde58f499 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:23.537173 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-7367d476-69e6-49c1-9480-865cde58f499 service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.2776318 Nov 18 21:03:23.595101 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:23.792385 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-273f3729-09a5-41a9-a371-97730ed4d6d0 req-b0494e30-dd80-4259-9747-fea7f2b621f4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:23.795063 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-273f3729-09a5-41a9-a371-97730ed4d6d0 req-b0494e30-dd80-4259-9747-fea7f2b621f4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1057596 Nov 18 21:03:23.844472 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-38fdccd0-664f-4936-9b1c-2b6f7c2e1237 x-openstack-request-id: req-38fdccd0-664f-4936-9b1c-2b6f7c2e1237 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:23.845931 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:23.846586 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-38fdccd0-664f-4936-9b1c-2b6f7c2e1237 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:23.847297 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'code': 200} Nov 18 21:03:23.939855 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-273f3729-09a5-41a9-a371-97730ed4d6d0 req-bac8f985-4382-4cf4-b70e-92b73c25adef tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1360395 Nov 18 21:03:24.126101 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-7e13456b-33eb-47f2-9cb9-e81177501887 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 217 time: 0.5630686 Nov 18 21:03:24.153280 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['1b0cf535-b83e-4422-af6f-57cc3b7cbd14'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:24.210389 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08c964e8-503e-435e-8074-38aadbc4559b req-b19077cf-5739-41c6-a79d-e184534f34ec tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:24.214418 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-08c964e8-503e-435e-8074-38aadbc4559b req-b19077cf-5739-41c6-a79d-e184534f34ec tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 943 time: 0.0908673 Nov 18 21:03:24.310684 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-08c964e8-503e-435e-8074-38aadbc4559b req-eac80d20-3d1b-4d75-8f67-53df6d7a046e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0843709 Nov 18 21:03:24.445366 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-512c64b0-b601-4ca2-8b89-f7ca8b40f373 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:24.448335 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-512c64b0-b601-4ca2-8b89-f7ca8b40f373 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.2866766 Nov 18 21:03:24.630623 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8585250-1576-40b6-9049-a89494fa7929 req-12bd0a70-8e99-417f-bd7a-edcff90f52b0 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:24.645126 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f8585250-1576-40b6-9049-a89494fa7929 req-12bd0a70-8e99-417f-bd7a-edcff90f52b0 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 932 time: 0.1729100 Nov 18 21:03:24.720771 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-3f343c09-4e5b-42bb-867f-2489dcc595b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:24.725654 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-3f343c09-4e5b-42bb-867f-2489dcc595b7 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2330823 Nov 18 21:03:24.869690 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2cbb3228-87b6-4812-adf3-e3651705e24b req-3cca2940-8090-4d96-94d3-80898cd06917 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 210 time: 0.1366243 Nov 18 21:03:24.882919 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f8585250-1576-40b6-9049-a89494fa7929 req-a350c355-10b2-4923-a4b7-5700eb0cda80 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2322581 Nov 18 21:03:24.947180 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 38d48d8e-6aab-43ea-b759-b7146853cbce {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:24.973999 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:24.989291 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Transition to ACTIVE for port object 38d48d8e-6aab-43ea-b759-b7146853cbce will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:03:25.005200 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:25.122563 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4edec871-336e-4e45-9e5b-d6f4d9d907e4 req-de0812f9-9358-4ad6-ad1f-92f5fd4d4614 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:25.133995 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4edec871-336e-4e45-9e5b-d6f4d9d907e4 req-de0812f9-9358-4ad6-ad1f-92f5fd4d4614 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 949 time: 0.0832834 Nov 18 21:03:25.214610 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4edec871-336e-4e45-9e5b-d6f4d9d907e4 req-000a83f3-6c08-4d91-a92a-072cd5f07828 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0789380 Nov 18 21:03:25.334378 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Pushing event updated for resources: {'Port': ['ID=38d48d8e-6aab-43ea-b759-b7146853cbce,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:25.362073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91869dba-0e2e-4bfc-8bac-590247b1bd22 req-6a5baf90-931d-498d-9f01-1301f783eca0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:25.377149 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91869dba-0e2e-4bfc-8bac-590247b1bd22 req-6a5baf90-931d-498d-9f01-1301f783eca0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.2722044 Nov 18 21:03:25.491660 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91869dba-0e2e-4bfc-8bac-590247b1bd22 req-706874b4-848d-49cf-8da9-1106dcf1a924 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1087878 Nov 18 21:03:25.578300 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a710a78-cf89-4687-b6fc-d0f61f1fa63b req-e5cbe927-a360-442c-b8a0-185d78994576 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:25.595385 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9a710a78-cf89-4687-b6fc-d0f61f1fa63b req-e5cbe927-a360-442c-b8a0-185d78994576 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1431251 Nov 18 21:03:25.668694 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-de1bec01-a727-4a6c-96d7-4252993504de service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.8124778 Nov 18 21:03:25.791176 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9a710a78-cf89-4687-b6fc-d0f61f1fa63b req-2b3d1cf7-30ab-4da7-a48d-5a532bbf1cde tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1927800 Nov 18 21:03:25.967773 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Attempting to bind port 38d48d8e-6aab-43ea-b759-b7146853cbce on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:03:25.968233 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Attempting to bind port 38d48d8e-6aab-43ea-b759-b7146853cbce by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:03:25.968608 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Attempting to bind port 38d48d8e-6aab-43ea-b759-b7146853cbce on network 114fdaf6-871a-4adc-a451-0c84b8e723ab {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:25.981640 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Port 38d48d8e-6aab-43ea-b759-b7146853cbce on network 114fdaf6-871a-4adc-a451-0c84b8e723ab not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:03:25.981972 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Attempting to bind port 38d48d8e-6aab-43ea-b759-b7146853cbce on network 114fdaf6-871a-4adc-a451-0c84b8e723ab {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:26.008473 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 3, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:03:26.008815 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Checking segment: {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:03:26.009260 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Bound using segment: {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:03:26.009720 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Bound port: 38d48d8e-6aab-43ea-b759-b7146853cbce, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'a71d8294-97d3-4004-81eb-f3aa0b67272e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 643, 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:03:26.010138 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:26.111669 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac08f294-f8a8-41c8-8935-d5a77906e582 req-2665da19-4441-42e3-8a9d-efdf6ad3e8ba tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:26.114669 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ac08f294-f8a8-41c8-8935-d5a77906e582 req-2665da19-4441-42e3-8a9d-efdf6ad3e8ba tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 943 time: 0.3675904 Nov 18 21:03:26.139592 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8d2d14bb-968e-41ad-9991-1e77f9329d45 req-593c4f9b-de4d-43ca-a58a-81ea189bcabd tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 210 time: 0.0450881 Nov 18 21:03:26.146391 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-22d36a1f-8e03-434c-a919-3a9b2770953c req-464b34a7-08ba-4a7b-b1f6-c6b9ff1ae83e service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4454501 Nov 18 21:03:26.300875 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] For port 38d48d8e-6aab-43ea-b759-b7146853cbce, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:03:26.334973 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ac08f294-f8a8-41c8-8935-d5a77906e582 req-e05fc0cb-7c9e-42ec-883d-b64366134527 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2128925 Nov 18 21:03:26.340769 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] For port 38d48d8e-6aab-43ea-b759-b7146853cbce, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=38d48d8e-6aab-43ea-b759-b7146853cbce,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:03:26.350617 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:26.356640 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-319c6e84-3c79-4d98-bcb9-790a5d6c5fd9 req-5ce3eb30-fc4d-41de-8fa5-f168c57f4ae4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:26.381817 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-319c6e84-3c79-4d98-bcb9-790a5d6c5fd9 req-5ce3eb30-fc4d-41de-8fa5-f168c57f4ae4 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 944 time: 0.1249061 Nov 18 21:03:26.548073 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-319c6e84-3c79-4d98-bcb9-790a5d6c5fd9 req-cfcd65b6-8c55-4480-a6a0-03ff4d915c61 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1644309 Nov 18 21:03:26.580760 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Pushing event updated for resources: {'Port': ['ID=38d48d8e-6aab-43ea-b759-b7146853cbce,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:26.658669 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e439a92d-6b32-4acc-93a3-91c54d8ca660 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:03:26.662576 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:03:26.888455 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-e1275b57-bc26-4c91-8a48-5714e6686ee3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:26.891450 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:26.892550 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:26.895565 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-e1275b57-bc26-4c91-8a48-5714e6686ee3 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.1253133 Nov 18 21:03:26.896988 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-f2fc077a-6f70-4dfb-b690-ef20df6ab3bf service neutron] 10.222.0.62 "PUT /v2.0/ports/38d48d8e-6aab-43ea-b759-b7146853cbce HTTP/1.1" status: 200 len: 1094 time: 3.9925277 Nov 18 21:03:26.897413 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'tag': '38d48d8e-6aab-43ea-b759-b7146853cbce'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:26.906772 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-760abf2a-25a7-4d05-9056-feebad37dff2" -d '{"events": [{"name": "network-changed", "server_uuid": "26739f4f-1d65-438e-8da7-4d8e0b65e5bc", "tag": "38d48d8e-6aab-43ea-b759-b7146853cbce"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:27.039769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:03:27.055616 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:27.056383 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:27.111456 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:27.129729 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'port_id': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'mac_address': 'fa:16:3e:ee:b9:e9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 649, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.5'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:03:27.159003 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdc1ec29-a1bd-4fc9-89d1-e78a1de3cdd5 req-405aaa67-81e4-45a1-a09e-52c3d0db67fc tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.175768 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fdc1ec29-a1bd-4fc9-89d1-e78a1de3cdd5 req-405aaa67-81e4-45a1-a09e-52c3d0db67fc tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 949 time: 0.2828383 Nov 18 21:03:27.209191 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:27.221028 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-a3fb4a13-0972-43da-ae22-5a16d71ba552 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.225963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-a3fb4a13-0972-43da-ae22-5a16d71ba552 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 809 time: 0.8294687 Nov 18 21:03:27.259004 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fdc1ec29-a1bd-4fc9-89d1-e78a1de3cdd5 req-fb0304b4-c8e5-4cae-bfb7-1681d47e2f86 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0816028 Nov 18 21:03:27.274569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-d02a0e18-1689-4845-afca-d1aa41fcc9b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.276301 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-d02a0e18-1689-4845-afca-d1aa41fcc9b8 service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 0.2828162 Nov 18 21:03:27.360955 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634a7761-3536-4e34-bea1-e4d5815aa38b req-30cb52e6-7ed8-49ae-b647-54fe779eff2e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.362929 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-634a7761-3536-4e34-bea1-e4d5815aa38b req-30cb52e6-7ed8-49ae-b647-54fe779eff2e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.3576949 Nov 18 21:03:27.412223 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-70d5acc2-1815-4621-82fb-26b75f245c97 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 217 time: 0.1195381 Nov 18 21:03:27.414129 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-91eb8792-36f8-499c-bb19-160f36f9656a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.418845 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-91eb8792-36f8-499c-bb19-160f36f9656a service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=851311932c184209baa31bf73923469b&device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 1097 time: 0.4349363 Nov 18 21:03:27.475029 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e439a92d-6b32-4acc-93a3-91c54d8ca660 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:27.482181 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bd817d70-6c9d-48f3-bca0-a4a2d5177f77 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d0f1cb43ab064a5388db98bf6b8228fa HTTP/1.1" status: 200 len: 378 time: 0.2305355 Nov 18 21:03:27.505907 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'port': {'device_id': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'admin_state_up': True, 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'security_groups': ['fbc78986-4204-4d3e-b1de-819272f7cec2']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:27.539857 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:27.547237 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:27.558019 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:27.631065 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:27.637123 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:27.639797 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-08f5eada-e53e-4e0b-b65f-c8f36891d04d" -d '{"events": [{"server_uuid": "a9569b0a-76bd-408d-98f8-4e5b08e979ab", "name": "network-vif-plugged", "status": "completed", "tag": "1b0cf535-b83e-4422-af6f-57cc3b7cbd14"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:27.652096 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:27.654276 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-dca0167b-d319-4a13-9513-e7ea80a94722 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=38d48d8e-6aab-43ea-b759-b7146853cbce HTTP/1.1" status: 200 len: 217 time: 0.1704035 Nov 18 21:03:27.672527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5b84cd8-ed96-4dc9-a367-4cab5ccf1ece req-807280fe-708e-49e2-a85f-fe201273137c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.681648 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a5b84cd8-ed96-4dc9-a367-4cab5ccf1ece req-807280fe-708e-49e2-a85f-fe201273137c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2677310 Nov 18 21:03:27.694231 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-744b9c18-c797-4c82-9ecc-d635ec64f212 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.702706 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-744b9c18-c797-4c82-9ecc-d635ec64f212 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.2245381 Nov 18 21:03:27.710603 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:27.769273 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-74d55983-61ff-4e72-9962-d02a0a20bae2 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0418859 Nov 18 21:03:27.820489 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-634a7761-3536-4e34-bea1-e4d5815aa38b req-f5fb5ec5-f845-4f7b-9ad0-fcc77aeb9a17 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4265049 Nov 18 21:03:27.849585 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:27.905993 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-6c2bdb3f-30a4-488b-a572-ae59d442d553 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:27.908591 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-6c2bdb3f-30a4-488b-a572-ae59d442d553 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=e48c8bc2-bbdc-434c-9eda-2ef0cb808732 HTTP/1.1" status: 200 len: 848 time: 0.2310395 Nov 18 21:03:27.978608 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a5b84cd8-ed96-4dc9-a367-4cab5ccf1ece req-26353622-0318-46ab-9918-4409f0617a3b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2731588 Nov 18 21:03:27.997961 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:26 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-71f0cde7-6ead-4e3a-a681-3f019c852d99 x-openstack-request-id: req-71f0cde7-6ead-4e3a-a681-3f019c852d99 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:27.998290 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "26739f4f-1d65-438e-8da7-4d8e0b65e5bc", "tag": "38d48d8e-6aab-43ea-b759-b7146853cbce", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:27.998905 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-71f0cde7-6ead-4e3a-a681-3f019c852d99 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:27.999577 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'tag': '38d48d8e-6aab-43ea-b759-b7146853cbce', 'status': 'completed', 'code': 200} Nov 18 21:03:28.058173 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-365c7cba-4bd4-4b5d-87af-41663f12ec4f service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=114fdaf6-871a-4adc-a451-0c84b8e723ab&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1158431 Nov 18 21:03:28.075341 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-802d172a-1e8f-4388-a58e-0eef230f01bd service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2782485 Nov 18 21:03:28.101347 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f6c04eba-0081-4a34-a821-315c8a85f4ce req-e7d64f2c-57c8-4b3a-97c9-ba585a297f3b tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 210 time: 0.0479372 Nov 18 21:03:28.103020 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Made reservation on behalf of d0f1cb43ab064a5388db98bf6b8228fa for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:03:28.110135 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:28.177907 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e439a92d-6b32-4acc-93a3-91c54d8ca660'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:28.352157 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d1cd512-deec-48ff-bc06-681a37c22521 req-f1c104c9-2628-4e00-97b1-27b7b6451636 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:28.358604 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3d1cd512-deec-48ff-bc06-681a37c22521 req-f1c104c9-2628-4e00-97b1-27b7b6451636 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 944 time: 0.2286751 Nov 18 21:03:28.495745 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-25fce39c-25d6-4b3c-8f7a-bdfffe78aaf0 req-3b11e597-294b-4902-94f3-f09e8a695603 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3863769 Nov 18 21:03:28.500883 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6007c755-847d-431f-a227-b5805702d735 req-c9da2354-d472-448e-ba90-98398662e144 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:28.522416 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3d1cd512-deec-48ff-bc06-681a37c22521 req-ba8ff6ce-2595-489c-bec9-5bd1ce2dbcab tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1533105 Nov 18 21:03:28.524398 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6007c755-847d-431f-a227-b5805702d735 req-c9da2354-d472-448e-ba90-98398662e144 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 944 time: 0.2627189 Nov 18 21:03:28.580728 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-59697566-0328-43a1-aee3-a1706729fde6 service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4634626 Nov 18 21:03:28.590651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-09ccdbed-a33e-4ca8-89b4-76ef32b05b58 x-openstack-request-id: req-09ccdbed-a33e-4ca8-89b4-76ef32b05b58 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:28.590651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9569b0a-76bd-408d-98f8-4e5b08e979ab", "name": "network-vif-plugged", "status": "completed", "tag": "1b0cf535-b83e-4422-af6f-57cc3b7cbd14", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:28.590651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-09ccdbed-a33e-4ca8-89b4-76ef32b05b58 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:28.591129 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14', 'code': 200} Nov 18 21:03:28.768884 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6007c755-847d-431f-a227-b5805702d735 req-b4ec8990-375d-48a3-8c5a-7b8a1878ecca tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2430983 Nov 18 21:03:28.788195 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Allocated IP 172.20.0.10 (95263b3e-fd72-450c-984a-4cc58b6e2e30/6050df59-9d5e-44e2-bfe4-f42645dc02a5/3efc1cde-bec6-4c4e-8d6f-abb2cecd7072) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:03:28.805953 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f8833a8-7dd2-4b67-963e-c0c0e01d00bf req-650c9a61-f255-4978-a570-0bd65cbf7be8 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:28.808465 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6f8833a8-7dd2-4b67-963e-c0c0e01d00bf req-650c9a61-f255-4978-a570-0bd65cbf7be8 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.1289527 Nov 18 21:03:28.822626 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3e247a48-97e1-4256-adc9-1e84b1631352 req-969690d7-b4ea-4ae7-94b6-17b05d67479b service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2012749 Nov 18 21:03:28.905399 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6f8833a8-7dd2-4b67-963e-c0c0e01d00bf req-f2d14642-a4d5-43a8-bb87-f21c4fd507aa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0866191 Nov 18 21:03:29.164011 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-d0e008b3-ff7e-49e4-826c-1708d1601044 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:29.166122 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-d0e008b3-ff7e-49e4-826c-1708d1601044 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=851311932c184209baa31bf73923469b&device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 1097 time: 0.1656947 Nov 18 21:03:29.286513 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b9ad57-fa00-45dd-bfc4-9345b391350d req-1253e09d-c393-4b9c-b143-a80930ced261 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:29.288236 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d4b9ad57-fa00-45dd-bfc4-9345b391350d req-1253e09d-c393-4b9c-b143-a80930ced261 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 1103 time: 0.2784493 Nov 18 21:03:29.318524 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6e6d0a2-7753-4583-bdb2-1254cc96f33f req-634946c1-314b-4365-b5e3-82df17741bb9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:29.320476 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f6e6d0a2-7753-4583-bdb2-1254cc96f33f req-634946c1-314b-4365-b5e3-82df17741bb9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.2141662 Nov 18 21:03:29.391122 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:29.474696 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d4b9ad57-fa00-45dd-bfc4-9345b391350d req-7e937c41-0358-450d-908b-a763bc30526c service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1654189 Nov 18 21:03:29.570152 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:29.701822 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:03:29.708257 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:03:29.740721 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da440f2b-6541-444c-bbc2-2b08ee09533c req-7d5cfabe-7246-4671-91e4-e73f40b8d512 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:29.755848 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-da440f2b-6541-444c-bbc2-2b08ee09533c req-7d5cfabe-7246-4671-91e4-e73f40b8d512 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.5556021 Nov 18 21:03:29.758721 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:29.763683 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:03:29.857313 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f6e6d0a2-7753-4583-bdb2-1254cc96f33f req-1b60d586-807f-42a7-a9d6-c650b271beed tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4983881 Nov 18 21:03:29.882861 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-d5aba414-3930-4442-b3d0-5bf28df179ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:29.885572 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-d5aba414-3930-4442-b3d0-5bf28df179ae service neutron] 10.222.0.62 "GET /v2.0/networks?id=114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 200 len: 909 time: 0.7058821 Nov 18 21:03:29.907037 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:29.907986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:29.921671 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-da440f2b-6541-444c-bbc2-2b08ee09533c req-96b26510-1b3d-4e55-bfdf-f198d36a74f2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1603985 Nov 18 21:03:29.942537 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-bb86f514-668a-41d1-9b87-d1a05e26db2f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.4433641 Nov 18 21:03:29.976029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Request body: {'port': {'device_id': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:30.029513 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-6476716b-6183-427d-9037-d6ee58cb1261 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=38d48d8e-6aab-43ea-b759-b7146853cbce HTTP/1.1" status: 200 len: 217 time: 0.1047950 Nov 18 21:03:30.198571 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edf41a1c-74be-4d85-809e-cb6bfed9b588 req-6c73574e-344d-4f90-a3fe-577854c5e24a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:30.209280 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-edf41a1c-74be-4d85-809e-cb6bfed9b588 req-6c73574e-344d-4f90-a3fe-577854c5e24a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 932 time: 0.1611278 Nov 18 21:03:30.215431 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-18b64743-edcd-42ed-947b-2f49c395679f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:30.218909 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:30.219474 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-18b64743-edcd-42ed-947b-2f49c395679f service neutron] 10.222.0.62 "GET /v2.0/subnets?id=e48c8bc2-bbdc-434c-9eda-2ef0cb808732 HTTP/1.1" status: 200 len: 848 time: 0.1779561 Nov 18 21:03:30.334606 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-c5b9432d-528f-4f68-9dbc-b0f14c50a87f service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=114fdaf6-871a-4adc-a451-0c84b8e723ab&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0912490 Nov 18 21:03:30.341504 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-e44ca025-40b1-41d5-93e0-e1e28a1fc38c None None] Provisioning complete for port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:30.342138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e44ca025-40b1-41d5-93e0-e1e28a1fc38c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:30.379631 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f3dfb12-1472-48cc-9f5d-cc31493ea7bc req-8460170f-578d-4a5b-a33e-ceb55e085d5c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:30.387291 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f3dfb12-1472-48cc-9f5d-cc31493ea7bc req-8460170f-578d-4a5b-a33e-ceb55e085d5c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 944 time: 0.1764936 Nov 18 21:03:30.478596 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-e44ca025-40b1-41d5-93e0-e1e28a1fc38c None None] Port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:03:30.545761 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-edf41a1c-74be-4d85-809e-cb6bfed9b588 req-4e16f96e-3a07-479e-988d-4da3d89863f1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.3356915 Nov 18 21:03:30.660543 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7f3dfb12-1472-48cc-9f5d-cc31493ea7bc req-b67d6d56-78d6-4f69-8d6c-e1c0582e7604 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2717240 Nov 18 21:03:30.673886 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e439a92d-6b32-4acc-93a3-91c54d8ca660 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:03:30.677229 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-fed43c4b-4140-4844-98c1-a989da00aa5b service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3294344 Nov 18 21:03:30.797452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port e439a92d-6b32-4acc-93a3-91c54d8ca660 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:03:30.834806 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port e439a92d-6b32-4acc-93a3-91c54d8ca660 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:30.835745 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:30.848548 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1654dc20-8592-4479-b567-5c95b5ca6f92 req-8eba67c5-87d6-4e9b-b51a-1d4fa1a29c98 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:30.859586 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1654dc20-8592-4479-b567-5c95b5ca6f92 req-8eba67c5-87d6-4e9b-b51a-1d4fa1a29c98 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 944 time: 0.1733761 Nov 18 21:03:31.032505 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1654dc20-8592-4479-b567-5c95b5ca6f92 req-2ee3033a-e4db-4827-89c8-4d1f1ad56e41 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1716542 Nov 18 21:03:31.033825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:31.059208 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c604060-a515-468a-90a2-19882e43c4d1 req-770a6f28-c101-4a68-9810-542e808b0dfa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:31.066105 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5c604060-a515-468a-90a2-19882e43c4d1 req-770a6f28-c101-4a68-9810-542e808b0dfa tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.2121282 Nov 18 21:03:31.069862 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-760abf2a-25a7-4d05-9056-feebad37dff2 req-ea7a0c1a-931e-44d4-b964-4a11b4129102 service neutron] 10.222.0.62 "GET /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3690033 Nov 18 21:03:31.104513 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:31.106573 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:31.111529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8be93bd0-1599-45c7-ae2b-a158d326449c" -d '{"events": [{"server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "name": "network-vif-plugged", "status": "completed", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:31.118623 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:31.195194 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:31.245970 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5c604060-a515-468a-90a2-19882e43c4d1 req-34a2b9fe-a2e0-427c-af8f-a39420cae358 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1684580 Nov 18 21:03:31.266151 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:31.307323 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:31.342425 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Transition to ACTIVE for port object 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:03:31.353660 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87bb7850-e675-46f7-b6a2-d115b0aca522 req-d339be7d-7b9e-49be-83eb-6c9b49d1124c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:31.355317 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-87bb7850-e675-46f7-b6a2-d115b0aca522 req-d339be7d-7b9e-49be-83eb-6c9b49d1124c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1731002 Nov 18 21:03:31.356731 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:31.493892 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13c8f54d-21d6-41b2-adf1-5bd0e20313f4 req-e8e53fe8-19ce-4993-98c8-f5f2a705491c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:31.497805 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-13c8f54d-21d6-41b2-adf1-5bd0e20313f4 req-e8e53fe8-19ce-4993-98c8-f5f2a705491c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1424284 Nov 18 21:03:31.581207 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-87bb7850-e675-46f7-b6a2-d115b0aca522 req-775e447a-ebc7-4a61-a2c5-9318b7476a54 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1961088 Nov 18 21:03:31.605452 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:31.649234 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-13c8f54d-21d6-41b2-adf1-5bd0e20313f4 req-0e590afa-9021-4cd1-87a3-c9e89c39d570 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1427152 Nov 18 21:03:31.710039 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Attempting to bind port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:03:31.710489 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Attempting to bind port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:03:31.710818 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Attempting to bind port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 on network 95263b3e-fd72-450c-984a-4cc58b6e2e30 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:31.720634 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 on network 95263b3e-fd72-450c-984a-4cc58b6e2e30 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:03:31.720987 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Attempting to bind port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 on network 95263b3e-fd72-450c-984a-4cc58b6e2e30 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:31.739647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 3, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:03:31.740099 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Checking segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:03:31.740544 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Bound using segment: {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:03:31.741011 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Bound port: 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'bf2c2c71-75a6-42ae-975a-74838c37b243', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 637, 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:03:31.741378 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:31.748406 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-053187c9-f6aa-4ad8-8057-d1093ea4b7aa x-openstack-request-id: req-053187c9-f6aa-4ad8-8057-d1093ea4b7aa {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:31.748980 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "name": "network-vif-plugged", "status": "completed", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:31.749213 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-053187c9-f6aa-4ad8-8057-d1093ea4b7aa {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:31.749885 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'code': 200} Nov 18 21:03:32.234557 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-811e71f6-81b5-4806-9115-0e4f29477714 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:32.249641 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b55b1e0-b529-4142-ab7b-559b55c513ee req-578e1ca1-580c-4118-9bf6-6895017844ba tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:32.256483 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1b55b1e0-b529-4142-ab7b-559b55c513ee req-578e1ca1-580c-4118-9bf6-6895017844ba tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.4312730 Nov 18 21:03:32.401600 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1b55b1e0-b529-4142-ab7b-559b55c513ee req-113640a0-4fae-487c-97c9-d8ded33cbac7 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1358666 Nov 18 21:03:32.539048 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47e9f1b3-680f-46f2-a1b1-01160e188ca7 req-9d39eeaf-e86c-4ffb-9e6f-7412600a01ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:32.546466 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-47e9f1b3-680f-46f2-a1b1-01160e188ca7 req-9d39eeaf-e86c-4ffb-9e6f-7412600a01ac service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1098 time: 0.1367571 Nov 18 21:03:32.670207 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 38d48d8e-6aab-43ea-b759-b7146853cbce details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:03:32.708566 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:03:32.718002 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:03:32.729864 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:32.759406 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-47e9f1b3-680f-46f2-a1b1-01160e188ca7 req-34751d1a-27d9-42b9-9a93-0f35293b7b5f service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1846714 Nov 18 21:03:32.765759 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aaf072a6-99dc-426a-8d6e-f5d8f895138c req-f9881560-417b-42de-9a60-02a5dc8a7e24 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:32.798628 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-aaf072a6-99dc-426a-8d6e-f5d8f895138c req-f9881560-417b-42de-9a60-02a5dc8a7e24 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.7996843 Nov 18 21:03:32.802611 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7d4e71-eaff-40d4-a57d-0d66afc9b4c2 req-3085934e-9684-4d34-8fa2-0c6b09ebe357 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:32.805996 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fb7d4e71-eaff-40d4-a57d-0d66afc9b4c2 req-3085934e-9684-4d34-8fa2-0c6b09ebe357 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 944 time: 0.2191207 Nov 18 21:03:32.813951 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:32.813951 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:32.814875 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] 10.222.0.62 "PUT /v2.0/ports/3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 1094 time: 2.8583281 Nov 18 21:03:32.815524 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:32.827900 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-69ea88eb-78c2-4960-a523-225ae3d299cf" -d '{"events": [{"name": "network-changed", "server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:32.910552 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 38d48d8e-6aab-43ea-b759-b7146853cbce, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=38d48d8e-6aab-43ea-b759-b7146853cbce,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:32.948262 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fb7d4e71-eaff-40d4-a57d-0d66afc9b4c2 req-9cb8909e-9e90-40f2-8c96-4f9bb2302bef tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1159682 Nov 18 21:03:32.960276 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '38d48d8e-6aab-43ea-b759-b7146853cbce', 'network_id': '114fdaf6-871a-4adc-a451-0c84b8e723ab', 'port_id': '38d48d8e-6aab-43ea-b759-b7146853cbce', 'mac_address': 'fa:16:3e:6a:e9:d3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 643, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'e48c8bc2-bbdc-434c-9eda-2ef0cb808732', 'ip_address': '172.20.0.14'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:03:33.041768 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:33.071726 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 38d48d8e-6aab-43ea-b759-b7146853cbce {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:33.129277 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22a9c4a9-749b-4c55-85e1-d8fd7208f2f3 service neutron] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:33.155759 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-aaf072a6-99dc-426a-8d6e-f5d8f895138c req-c49b04d3-e62e-4f5e-9f08-5c58b837705d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3560355 Nov 18 21:03:33.176602 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 38d48d8e-6aab-43ea-b759-b7146853cbce, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=38d48d8e-6aab-43ea-b759-b7146853cbce,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:33.191249 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:33.265152 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba7b45ec-208d-48eb-90de-644390aad6a5 req-dcd29fb4-e5aa-4861-9fcb-0147745af34a tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:33.266815 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ba7b45ec-208d-48eb-90de-644390aad6a5 req-dcd29fb4-e5aa-4861-9fcb-0147745af34a tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.1727359 Nov 18 21:03:33.275276 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-9e45ec73-0ffb-4acc-8c20-f1669e49e141 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:33.277034 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-9e45ec73-0ffb-4acc-8c20-f1669e49e141 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1097 time: 0.0972955 Nov 18 21:03:33.385700 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ba7b45ec-208d-48eb-90de-644390aad6a5 req-ba176e63-4f27-4582-bd4e-b06d08d7433c tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1025851 Nov 18 21:03:33.389669 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=38d48d8e-6aab-43ea-b759-b7146853cbce,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:33.410442 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-e03710ce-32e0-4175-88c6-19e18006a9cc service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 217 time: 0.1006713 Nov 18 21:03:33.743616 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-946997b8-e01c-458b-8107-8e887307d782 req-cb2a7381-53a5-4567-b1b2-c012a2ce6759 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:33.743616 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-946997b8-e01c-458b-8107-8e887307d782 req-cb2a7381-53a5-4567-b1b2-c012a2ce6759 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.3439195 Nov 18 21:03:33.745042 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37dee77d-9014-4efc-8791-5beeda8adf55 req-1b0d06a0-dcd1-448d-b170-9fb9fffa4b64 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:33.749570 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-54d52c7f-fa06-4e20-a297-5ab7ee6c0aa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:33.757317 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-37dee77d-9014-4efc-8791-5beeda8adf55 req-1b0d06a0-dcd1-448d-b170-9fb9fffa4b64 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2015579 Nov 18 21:03:33.770341 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-54d52c7f-fa06-4e20-a297-5ab7ee6c0aa3 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.3171976 Nov 18 21:03:33.935529 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-37dee77d-9014-4efc-8791-5beeda8adf55 req-8a97d3b8-60bf-48b0-a016-0c7357dbf83c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1764095 Nov 18 21:03:34.101726 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-aba6ce35-1c9f-42bf-a3cd-ffcc5b2f3622 x-openstack-request-id: req-aba6ce35-1c9f-42bf-a3cd-ffcc5b2f3622 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:34.101726 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:34.102826 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-aba6ce35-1c9f-42bf-a3cd-ffcc5b2f3622 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:34.105909 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'status': 'completed', 'code': 200} Nov 18 21:03:34.191548 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-606918b7-2941-4744-ad92-7653c900e7c0 req-6852f6af-38fb-4453-a5dd-e9da5bf23e25 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:34.193415 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-6852f6af-38fb-4453-a5dd-e9da5bf23e25 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3975198 Nov 18 21:03:34.213489 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-946997b8-e01c-458b-8107-8e887307d782 req-1fb0a41a-81f0-47fe-a251-277479237c72 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4409232 Nov 18 21:03:34.261732 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['38d48d8e-6aab-43ea-b759-b7146853cbce'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:34.353726 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcd30da2-b80e-45a7-a1ee-b239d4a7bea9 req-0b4c8724-7d7e-4813-aca3-49d02c80693a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:34.357548 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dcd30da2-b80e-45a7-a1ee-b239d4a7bea9 req-0b4c8724-7d7e-4813-aca3-49d02c80693a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.1905274 Nov 18 21:03:34.495187 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-82c3bdd8-783f-4510-83e4-1dc4d6f5df17 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2632718 Nov 18 21:03:34.524486 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dcd30da2-b80e-45a7-a1ee-b239d4a7bea9 req-85799e55-7ee1-45c2-9122-af6e2ab0b091 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1555371 Nov 18 21:03:34.678686 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-78cda727-7d36-400a-9d74-b6e0c4d62444 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:34.741810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6404093e-912e-4b00-8fc7-09b84594d1b4 req-2487279c-0986-4384-9d30-c767d8ce608b tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:34.744668 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6404093e-912e-4b00-8fc7-09b84594d1b4 req-2487279c-0986-4384-9d30-c767d8ce608b tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 945 time: 0.1004055 Nov 18 21:03:34.781094 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88759588-c9e0-48c0-82ee-6535815b638f req-821da479-08d2-4920-a626-9106222cbb96 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:34.786143 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88759588-c9e0-48c0-82ee-6535815b638f req-821da479-08d2-4920-a626-9106222cbb96 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.1232333 Nov 18 21:03:34.807397 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-606918b7-2941-4744-ad92-7653c900e7c0 req-dcd9ec5e-df2f-4fbc-bb47-52dd7ec16873 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2878637 Nov 18 21:03:34.934612 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6404093e-912e-4b00-8fc7-09b84594d1b4 req-8ff5630e-e9e5-49c8-9992-1e1d81af58bf tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1575315 Nov 18 21:03:34.937052 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-88759588-c9e0-48c0-82ee-6535815b638f req-c41c609a-fd18-49f3-8774-8269a4a40185 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1342885 Nov 18 21:03:35.088947 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-3821b1df-1866-4721-919a-74e3ce37aad9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:35.091681 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-3821b1df-1866-4721-919a-74e3ce37aad9 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1097 time: 0.1544552 Nov 18 21:03:35.247917 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c367b75d-f4dc-43eb-b6be-3eb1afd7f2f9 req-4df059b1-4a55-420c-b450-a9773d589c83 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:35.259026 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c367b75d-f4dc-43eb-b6be-3eb1afd7f2f9 req-4df059b1-4a55-420c-b450-a9773d589c83 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1456137 Nov 18 21:03:35.439781 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a6a346b-0303-4228-8a60-d4386a05f387 req-21997011-3c65-4bf3-b934-48455908d89f tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:35.456597 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8a6a346b-0303-4228-8a60-d4386a05f387 req-21997011-3c65-4bf3-b934-48455908d89f tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.3558979 Nov 18 21:03:35.559468 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c367b75d-f4dc-43eb-b6be-3eb1afd7f2f9 req-a71dd764-3e05-4bdd-b552-49e462f5bf14 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2743111 Nov 18 21:03:35.785604 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-a1609372-64bb-4f05-ba1b-3f4cc2be8a3b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:35.797887 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-a1609372-64bb-4f05-ba1b-3f4cc2be8a3b service neutron] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 910 time: 0.6370161 Nov 18 21:03:35.822729 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8a6a346b-0303-4228-8a60-d4386a05f387 req-127d6b2b-84f3-4925-a1e2-a9aef5b9bdd2 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3447690 Nov 18 21:03:35.953919 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-3e71fec7-1a02-4f20-b994-3a521bc44570 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 217 time: 0.1246796 Nov 18 21:03:36.009120 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:36.037480 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7492b666-f7ee-474e-8ec7-b7689469f49e req-bef6ade7-b0e2-481b-8ceb-e4e3e46e86f7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:36.041051 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7492b666-f7ee-474e-8ec7-b7689469f49e req-bef6ade7-b0e2-481b-8ceb-e4e3e46e86f7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1981399 Nov 18 21:03:36.211232 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-1e2f6310-8838-4308-895e-8cf72ef8e6f7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:36.220417 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-1e2f6310-8838-4308-895e-8cf72ef8e6f7 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.2500665 Nov 18 21:03:36.349299 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7492b666-f7ee-474e-8ec7-b7689469f49e req-cbebc414-d1dc-4d4d-96ae-0abc26c83ffb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2815545 Nov 18 21:03:36.455418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-80eab4dc-5416-4060-93a7-2461a8d5c88d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:36.459548 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-80eab4dc-5416-4060-93a7-2461a8d5c88d service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2230041 Nov 18 21:03:36.530697 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8dc1b048-3e00-4995-8d97-e363f9c5510a req-5f0e7143-845e-497e-a8e2-c905508b58db tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:36.540230 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8dc1b048-3e00-4995-8d97-e363f9c5510a req-5f0e7143-845e-497e-a8e2-c905508b58db tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.1648393 Nov 18 21:03:36.777530 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8dc1b048-3e00-4995-8d97-e363f9c5510a req-8b129c6a-58de-4008-99f9-01cfdbdaf753 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2361524 Nov 18 21:03:36.798700 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-2b97d25c-bec4-44f2-b1f2-64fb81f3e2e3 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3105073 Nov 18 21:03:37.063978 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d02552f0-8ce5-4eed-accb-6597e43c6394 req-6cfdb697-a58d-48eb-9238-fe3ae7ee33c3 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:37.076942 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d02552f0-8ce5-4eed-accb-6597e43c6394 req-6cfdb697-a58d-48eb-9238-fe3ae7ee33c3 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.1460526 Nov 18 21:03:37.107854 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6190ffa-025a-47c2-8932-618461520196 req-e03e5040-0e88-4d22-8558-43e95a54718e tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:37.122636 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b6190ffa-025a-47c2-8932-618461520196 req-e03e5040-0e88-4d22-8558-43e95a54718e tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 945 time: 0.1369123 Nov 18 21:03:37.156932 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-69ea88eb-78c2-4960-a523-225ae3d299cf req-f7d84b54-f30a-4fc1-8559-4a88707cde3a service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3241224 Nov 18 21:03:37.208485 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d02552f0-8ce5-4eed-accb-6597e43c6394 req-58fe21f1-b46d-463c-b738-5e607c27cf95 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1230631 Nov 18 21:03:37.240524 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b6190ffa-025a-47c2-8932-618461520196 req-9bf14f9b-bc42-4801-96fc-44a05ddefeba tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1150327 Nov 18 21:03:37.420537 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98e4f815-a2f7-443f-8913-26412f3fd740 req-ff750ccd-5e67-4e60-bc23-8bf155ce54f1 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:37.423659 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-98e4f815-a2f7-443f-8913-26412f3fd740 req-ff750ccd-5e67-4e60-bc23-8bf155ce54f1 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.1149068 Nov 18 21:03:37.530856 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:37.681584 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-98e4f815-a2f7-443f-8913-26412f3fd740 req-5b1a4b00-2cfc-46b9-8851-52cb89ea14fc tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2512176 Nov 18 21:03:37.965680 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b6a45ff-4a9a-4681-bcc9-5f6f075a0aff req-d62657e2-ac76-44c8-b936-bbb64f488e9f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:37.978883 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe5deec6-8da5-4a53-97f5-5a9419096e9a req-79e65182-1fce-43c6-bf1e-a21ad2438bcc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:37.982866 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0b6a45ff-4a9a-4681-bcc9-5f6f075a0aff req-d62657e2-ac76-44c8-b936-bbb64f488e9f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.1527071 Nov 18 21:03:37.990370 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fe5deec6-8da5-4a53-97f5-5a9419096e9a req-79e65182-1fce-43c6-bf1e-a21ad2438bcc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0939078 Nov 18 21:03:38.079155 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fe5deec6-8da5-4a53-97f5-5a9419096e9a req-73134b51-90ea-426f-b39f-be8283dc07d6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0873003 Nov 18 21:03:38.155878 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0b6a45ff-4a9a-4681-bcc9-5f6f075a0aff req-74f61d2f-d77f-4fc5-9a30-434b85a9810c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1660519 Nov 18 21:03:38.224408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0252641d-27e2-4138-9728-8d7f95fa20cd req-2ee4d467-e836-4d42-b559-d1f3af973a6f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:38.226480 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0252641d-27e2-4138-9728-8d7f95fa20cd req-2ee4d467-e836-4d42-b559-d1f3af973a6f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0734098 Nov 18 21:03:38.295494 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:38.340381 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c578a9f4-ecd8-4598-ab58-b3110f40b58f req-4e3dc605-f235-4dce-ae5f-344129675985 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:38.349875 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c578a9f4-ecd8-4598-ab58-b3110f40b58f req-4e3dc605-f235-4dce-ae5f-344129675985 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0801110 Nov 18 21:03:38.378442 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0252641d-27e2-4138-9728-8d7f95fa20cd req-cc14188d-ba28-4eb3-9899-75b93f7bbe4e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1142950 Nov 18 21:03:38.439108 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c578a9f4-ecd8-4598-ab58-b3110f40b58f req-e914ea5d-ede2-4edc-9650-dadd0129c26e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0875952 Nov 18 21:03:38.699608 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 38d48d8e-6aab-43ea-b759-b7146853cbce up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:03:38.751697 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b401586-90ab-4c85-9d3b-86bbe2cb1e9c req-ec6812bf-4fd3-44b7-911c-646aec21e729 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:38.761368 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4b401586-90ab-4c85-9d3b-86bbe2cb1e9c req-ec6812bf-4fd3-44b7-911c-646aec21e729 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 945 time: 0.1068604 Nov 18 21:03:38.897992 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 38d48d8e-6aab-43ea-b759-b7146853cbce completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:03:38.905933 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 38d48d8e-6aab-43ea-b759-b7146853cbce triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:38.906611 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:38.907223 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4b401586-90ab-4c85-9d3b-86bbe2cb1e9c req-03f2b037-8ced-49b2-8f08-88ac0676bc86 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1443594 Nov 18 21:03:39.084839 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:39.094358 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-f71d124a-3397-4e41-b261-771aa0225adf tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:39.098452 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-f71d124a-3397-4e41-b261-771aa0225adf tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.62 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.1678348 Nov 18 21:03:39.140129 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38d48d8e-6aab-43ea-b759-b7146853cbce'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:39.144885 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-db17325d-1cd6-4980-9951-41adfab49821" -d '{"events": [{"server_uuid": "26739f4f-1d65-438e-8da7-4d8e0b65e5bc", "name": "network-vif-plugged", "status": "completed", "tag": "38d48d8e-6aab-43ea-b759-b7146853cbce"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:39.173981 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 38d48d8e-6aab-43ea-b759-b7146853cbce, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=38d48d8e-6aab-43ea-b759-b7146853cbce,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:39.189954 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:39.360453 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fff46723-c0f9-4c36-9aaa-5abdce574f81 req-74ae8dcc-0a0a-429c-bba2-d7ef915e2116 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:39.369490 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fff46723-c0f9-4c36-9aaa-5abdce574f81 req-74ae8dcc-0a0a-429c-bba2-d7ef915e2116 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 950 time: 0.2685292 Nov 18 21:03:39.407214 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=38d48d8e-6aab-43ea-b759-b7146853cbce,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:39.530628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Deleting port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:03:39.531074 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:39.537942 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fff46723-c0f9-4c36-9aaa-5abdce574f81 req-47ca40d6-5312-4ca1-afca-1e91039f1fc5 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/security-groups?id=21e31e1c-e685-4f8e-ab5c-f14f102db6f3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1674702 Nov 18 21:03:39.850674 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] For port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,segment=NetworkSegment(82745c4d-5ef9-430f-8b50-cf3a463c6b2c),segment_id=82745c4d-5ef9-430f-8b50-cf3a463c6b2c)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:39.851233 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:39.870058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Calling delete_port for 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:03:39.982922 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e05f0d0c-d81c-4ba1-a49f-c83ffa4b5e09 req-3541a2b0-1946-4cb1-aeaa-d6c85a907597 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:39.985469 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e05f0d0c-d81c-4ba1-a49f-c83ffa4b5e09 req-3541a2b0-1946-4cb1-aeaa-d6c85a907597 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.2797530 Nov 18 21:03:39.990029 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2042055a-2ed1-4417-81f4-4c6c3d6474d4 req-3176ff74-7191-496d-80a1-3bfee337c0d8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:40.007279 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2042055a-2ed1-4417-81f4-4c6c3d6474d4 req-3176ff74-7191-496d-80a1-3bfee337c0d8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1365001 Nov 18 21:03:40.133820 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2042055a-2ed1-4417-81f4-4c6c3d6474d4 req-39e44ced-b014-4eb7-a70c-f56acece9a1b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1270559 Nov 18 21:03:40.219619 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e05f0d0c-d81c-4ba1-a49f-c83ffa4b5e09 req-a70bca60-f87e-44bb-9cd9-645b9561cce8 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2147913 Nov 18 21:03:40.271764 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f111053c-246c-473a-a43b-4319075f36e4 x-openstack-request-id: req-f111053c-246c-473a-a43b-4319075f36e4 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:40.272366 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "26739f4f-1d65-438e-8da7-4d8e0b65e5bc", "name": "network-vif-plugged", "status": "completed", "tag": "38d48d8e-6aab-43ea-b759-b7146853cbce", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:40.273011 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f111053c-246c-473a-a43b-4319075f36e4 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:40.273313 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '38d48d8e-6aab-43ea-b759-b7146853cbce', 'code': 200} Nov 18 21:03:40.303722 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:40.321958 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['1b0cf535-b83e-4422-af6f-57cc3b7cbd14'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:40.451018 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Pushing event deleted for resources: {'Port': ['ID=1b0cf535-b83e-4422-af6f-57cc3b7cbd14,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:40.733813 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] No DVR routers for this DVR port 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:03:40.755564 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50dfeee9-1bda-446a-84a6-4d6e74cec24c req-72432da0-0ad5-4629-8db0-0e14daeaeba7 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:40.774173 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-50dfeee9-1bda-446a-84a6-4d6e74cec24c req-72432da0-0ad5-4629-8db0-0e14daeaeba7 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.3238883 Nov 18 21:03:40.782128 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da81ff88-7a5a-4cd0-a88c-ca0c5e9f5122 req-67ba5a4a-68d5-423d-889d-5001b59ee7e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:40.782402 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:40.784167 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-da81ff88-7a5a-4cd0-a88c-ca0c5e9f5122 req-67ba5a4a-68d5-423d-889d-5001b59ee7e7 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 1099 time: 0.1715991 Nov 18 21:03:40.789702 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74a57a21-0c35-4b18-9ec6-85fe250f3398 req-7ba90f51-5b90-49e7-a6ff-e2617ceb1671 tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.62 "DELETE /v2.0/ports/1b0cf535-b83e-4422-af6f-57cc3b7cbd14 HTTP/1.1" status: 204 len: 173 time: 1.6635711 Nov 18 21:03:40.790518 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'name': 'network-vif-deleted', 'tag': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:40.795689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-440624fb-0321-454e-8a6f-d9f909e5a050" -d '{"events": [{"server_uuid": "a9569b0a-76bd-408d-98f8-4e5b08e979ab", "name": "network-vif-deleted", "tag": "1b0cf535-b83e-4422-af6f-57cc3b7cbd14"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:40.889459 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e6b7433-147d-49fd-9537-48999b4af217 req-b5f595a7-fa5d-4b3c-9359-ea7a563ac23c tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:40.896100 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7e6b7433-147d-49fd-9537-48999b4af217 req-b5f595a7-fa5d-4b3c-9359-ea7a563ac23c tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.2497346 Nov 18 21:03:40.964616 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-da81ff88-7a5a-4cd0-a88c-ca0c5e9f5122 req-34f141ea-558c-4d16-8b4e-5d3270aa5f33 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1225207 Nov 18 21:03:41.016696 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-50dfeee9-1bda-446a-84a6-4d6e74cec24c req-afce78f8-8c56-4498-97fa-4e2640323ec5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2373548 Nov 18 21:03:41.175094 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7e6b7433-147d-49fd-9537-48999b4af217 req-8adf0a14-58d5-4964-98d9-3cc61e61852d tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2351556 Nov 18 21:03:41.284216 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:40 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-feb73841-c530-43f1-ba6a-197c6a9895c6 x-openstack-request-id: req-feb73841-c530-43f1-ba6a-197c6a9895c6 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:41.285134 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a9569b0a-76bd-408d-98f8-4e5b08e979ab", "name": "network-vif-deleted", "tag": "1b0cf535-b83e-4422-af6f-57cc3b7cbd14", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:41.285561 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-feb73841-c530-43f1-ba6a-197c6a9895c6 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:41.286221 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a9569b0a-76bd-408d-98f8-4e5b08e979ab', 'name': 'network-vif-deleted', 'tag': '1b0cf535-b83e-4422-af6f-57cc3b7cbd14', 'status': 'completed', 'code': 200} Nov 18 21:03:41.465464 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e3282762-8c9a-4766-b3c0-54139ee2e2ed req-a7c2010a-a8c0-404d-991a-8849395b0bea tempest-VolumesNegativeTest-1497596767 tempest-VolumesNegativeTest-1497596767-project] 10.222.0.61 "GET /v2.0/ports?device_id=a9569b0a-76bd-408d-98f8-4e5b08e979ab HTTP/1.1" status: 200 len: 210 time: 0.0661786 Nov 18 21:03:41.500153 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3aa6147-ca20-47a5-95c1-3fbd598cda2b req-9588f642-34c0-4834-9167-6205e54cec07 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:41.508962 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c3aa6147-ca20-47a5-95c1-3fbd598cda2b req-9588f642-34c0-4834-9167-6205e54cec07 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0963423 Nov 18 21:03:41.589432 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c3aa6147-ca20-47a5-95c1-3fbd598cda2b req-c9e605e3-9c7c-4768-8a6d-61b38cba7597 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0827129 Nov 18 21:03:42.193469 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd82d723-028c-47e9-9899-c5a50dde5c10 req-2e149c77-0229-4c1b-bca0-b9563d25a03a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:42.195161 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd82d723-028c-47e9-9899-c5a50dde5c10 req-2e149c77-0229-4c1b-bca0-b9563d25a03a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0759559 Nov 18 21:03:42.304349 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd82d723-028c-47e9-9899-c5a50dde5c10 req-075250a1-edce-4919-b216-f0894c31dc8f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1004367 Nov 18 21:03:42.553880 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fea9b99b-2acd-4307-93fa-1c55d21b9443 req-73a4b3d1-0cbc-4ea1-8f5d-cc50417d8cc7 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:42.557954 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fea9b99b-2acd-4307-93fa-1c55d21b9443 req-73a4b3d1-0cbc-4ea1-8f5d-cc50417d8cc7 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.1437216 Nov 18 21:03:42.677326 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fea9b99b-2acd-4307-93fa-1c55d21b9443 req-6ddede4a-c1d2-4392-a536-0db4a8f01006 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1029630 Nov 18 21:03:42.715772 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:03:42.749583 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:03:42.750225 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1b0cf535-b83e-4422-af6f-57cc3b7cbd14 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:03:42.984201 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fd9f5bd-8c7a-4226-85c4-de7c3bdb429c req-f160e33a-568c-410c-bfe6-6d7a7ae9b839 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:42.987097 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1fd9f5bd-8c7a-4226-85c4-de7c3bdb429c req-f160e33a-568c-410c-bfe6-6d7a7ae9b839 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1004243 Nov 18 21:03:43.163437 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1fd9f5bd-8c7a-4226-85c4-de7c3bdb429c req-c740e241-35d7-4760-8063-7d55485f1077 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1681936 Nov 18 21:03:44.228965 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdae05db-4f9b-4279-b6c1-3d8269b79847 req-5d5008e7-4c65-473a-a44f-d4d16de22bf8 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:44.298540 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fdae05db-4f9b-4279-b6c1-3d8269b79847 req-5d5008e7-4c65-473a-a44f-d4d16de22bf8 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.1965337 Nov 18 21:03:44.473933 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fdae05db-4f9b-4279-b6c1-3d8269b79847 req-6ad9ef83-8ece-413b-8a80-b6533a8e4060 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1630809 Nov 18 21:03:44.679092 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ee3b33f-d9af-42ec-9afd-b491f140559e req-b3e23394-36e9-47c0-898a-79b17a622cb9 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:44.681789 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ee3b33f-d9af-42ec-9afd-b491f140559e req-b3e23394-36e9-47c0-898a-79b17a622cb9 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.0920951 Nov 18 21:03:44.726242 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:03:44.799528 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4ee3b33f-d9af-42ec-9afd-b491f140559e req-8b519e38-1ee7-4e45-bb04-992dd1c05bfd tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0971010 Nov 18 21:03:44.962915 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:44.985160 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'port_id': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'mac_address': 'fa:16:3e:e3:7b:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 637, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:03:45.025732 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeaf444c-8188-4993-8c7e-426d13b809f2 req-ed0d8342-60f5-4242-a391-5af5ab9e8e60 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:45.027344 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eeaf444c-8188-4993-8c7e-426d13b809f2 req-ed0d8342-60f5-4242-a391-5af5ab9e8e60 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0617690 Nov 18 21:03:45.056840 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:45.078536 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:45.134633 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:45.143912 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:45.168233 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eeaf444c-8188-4993-8c7e-426d13b809f2 req-887079e8-362c-4f90-92c3-a455288a5d0d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1316626 Nov 18 21:03:45.278904 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:45.735634 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a808266b-28b8-4d03-a9c6-28c69cea70fa req-8279b1c3-b934-4579-8939-d005dae6c2e4 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:45.747447 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a808266b-28b8-4d03-a9c6-28c69cea70fa req-8279b1c3-b934-4579-8939-d005dae6c2e4 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 945 time: 0.1069956 Nov 18 21:03:45.870903 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:45.902756 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a808266b-28b8-4d03-a9c6-28c69cea70fa req-c0cc0d63-97e1-4706-8df8-d15cd12c771a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1536989 Nov 18 21:03:46.423613 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2622eef7-6e7c-41c7-b996-15e4071c2333 req-e4f568da-0bbb-45e3-a469-0309124e1190 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:46.425962 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2622eef7-6e7c-41c7-b996-15e4071c2333 req-e4f568da-0bbb-45e3-a469-0309124e1190 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.0736341 Nov 18 21:03:46.508278 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2622eef7-6e7c-41c7-b996-15e4071c2333 req-81a856eb-ab7e-4d2a-9cda-a08f1f89a81e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0742214 Nov 18 21:03:46.748506 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a89af29f-d11f-43a8-8e45-33acc00c9fa9 req-c1815338-6933-4dd4-baaf-44476faecd7d tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:46.751305 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a89af29f-d11f-43a8-8e45-33acc00c9fa9 req-c1815338-6933-4dd4-baaf-44476faecd7d tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.1132882 Nov 18 21:03:46.794511 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-d92c1616-e6df-44a5-9477-2b2d3e11dcdc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:46.797509 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-d92c1616-e6df-44a5-9477-2b2d3e11dcdc tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.2225459 Nov 18 21:03:46.841779 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-00d67bac-428c-4eff-8f4f-577ad99e180b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/quotas/05431e285025437d8783475290b4e4fc HTTP/1.1" status: 200 len: 375 time: 0.0202608 Nov 18 21:03:46.861436 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a89af29f-d11f-43a8-8e45-33acc00c9fa9 req-15ac7612-17f2-431c-95ce-5daab348b2df tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974762 Nov 18 21:03:46.946502 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-2e95fad4-f23a-4660-8b23-c7ff7f180c45 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0897300 Nov 18 21:03:47.083508 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b98e443-aaee-4fbb-8072-431f20d840b8 req-fe15da0a-e7a7-4034-81d1-d01d003e12cb tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:47.088821 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6b98e443-aaee-4fbb-8072-431f20d840b8 req-fe15da0a-e7a7-4034-81d1-d01d003e12cb tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 945 time: 0.0997839 Nov 18 21:03:47.113147 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-50411d5d-c30f-47b5-abe7-0344beec413e service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1476099 Nov 18 21:03:47.204998 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6b98e443-aaee-4fbb-8072-431f20d840b8 req-bb990115-539a-4660-acca-d213916e171a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1081476 Nov 18 21:03:47.273000 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-2070b81e-e80e-4c5b-98e7-7680fb22bd6d service neutron] 10.222.0.61 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1513636 Nov 18 21:03:47.516885 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eda07724-e6bf-4f93-a155-484548ba4549 req-53b52204-8996-477e-ba51-f90921696395 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 210 time: 0.0418668 Nov 18 21:03:47.796672 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ea8db6e-1bdd-49be-a6fc-720b57cb7ebb req-fe31e955-4fae-4d11-9121-5d370e09ea3e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:47.796672 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8ea8db6e-1bdd-49be-a6fc-720b57cb7ebb req-fe31e955-4fae-4d11-9121-5d370e09ea3e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1288700 Nov 18 21:03:47.988253 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8ea8db6e-1bdd-49be-a6fc-720b57cb7ebb req-17838aad-1197-4884-8b7c-646269762973 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1842113 Nov 18 21:03:48.090300 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd7aecd6-2d5c-4694-a5de-49da80dfc9da req-ffaabd5f-373b-464d-8bbc-cfd5f485d9e8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:48.101046 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dd7aecd6-2d5c-4694-a5de-49da80dfc9da req-ffaabd5f-373b-464d-8bbc-cfd5f485d9e8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.0749340 Nov 18 21:03:48.194491 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dd7aecd6-2d5c-4694-a5de-49da80dfc9da req-febe4756-f1a6-4710-b003-52761d16ddc8 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0847323 Nov 18 21:03:48.422145 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ce0a8b3-5fbf-4ca0-8bce-bc2f659f2344 req-beb494f2-af62-41d0-88ac-9185cb59de1a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:48.428943 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ce0a8b3-5fbf-4ca0-8bce-bc2f659f2344 req-beb494f2-af62-41d0-88ac-9185cb59de1a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 945 time: 0.1076510 Nov 18 21:03:48.625098 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ce0a8b3-5fbf-4ca0-8bce-bc2f659f2344 req-b3e88f60-ed2c-496f-9f3e-e1ec37f990a1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1792989 Nov 18 21:03:48.696617 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-b90ccfd5-2245-4a86-b96a-c73cd009c504 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:48.700496 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-b90ccfd5-2245-4a86-b96a-c73cd009c504 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1099 time: 0.1130135 Nov 18 21:03:48.741330 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:03:48.850474 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1b7b8d3b-b996-4381-8977-23fcfdacd502 req-2166d2ef-c718-4365-869f-ac231a17deb8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 210 time: 0.1304846 Nov 18 21:03:48.861484 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:03:48.874880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:03:48.874880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:49.042506 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-eff4f35d-15da-4dc1-a221-0ef62d04c847 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.044770 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-eff4f35d-15da-4dc1-a221-0ef62d04c847 service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.2961311 Nov 18 21:03:49.132267 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:49.193305 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-16056e63-0a39-4fe1-bc14-4b0c6cf28170 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 200 len: 1002 time: 0.1315989 Nov 18 21:03:49.206290 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:49.208694 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5f84cc79-2992-4464-93c3-d46b61b31431" -d '{"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-plugged", "status": "completed", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:49.226640 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:49.235772 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:49.283129 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4751b51f-e004-4fa3-a56d-6a37e9f1efd8 req-6dc29289-b654-4a01-9936-f077bdc10920 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.293949 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4751b51f-e004-4fa3-a56d-6a37e9f1efd8 req-6dc29289-b654-4a01-9936-f077bdc10920 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1120756 Nov 18 21:03:49.305076 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a81908c4-1547-4bc3-aa4a-ac7e550ffb91 x-openstack-request-id: req-a81908c4-1547-4bc3-aa4a-ac7e550ffb91 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:49.306087 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-plugged", "status": "completed", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:49.306518 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a81908c4-1547-4bc3-aa4a-ac7e550ffb91 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:49.308468 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'code': 200} Nov 18 21:03:49.383474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:49.387988 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4751b51f-e004-4fa3-a56d-6a37e9f1efd8 req-9d150e67-5290-4f94-99dc-9442b431fac0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0922787 Nov 18 21:03:49.406147 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-8cf5a348-7b69-4a2f-b603-a60a48e8e9cb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.410433 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-8cf5a348-7b69-4a2f-b603-a60a48e8e9cb service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.1895688 Nov 18 21:03:49.412154 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:49.577466 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-b583688c-759f-40a3-8033-88e1d51df0a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.580190 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-b583688c-759f-40a3-8033-88e1d51df0a4 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1560538 Nov 18 21:03:49.598944 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b41ad439-c010-45ff-82e0-db7beaaf1aff req-2d5fab98-a87c-4cfc-82e0-5c3e9c5503f1 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.601950 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b41ad439-c010-45ff-82e0-db7beaaf1aff req-2d5fab98-a87c-4cfc-82e0-5c3e9c5503f1 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.1210511 Nov 18 21:03:49.829221 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b41ad439-c010-45ff-82e0-db7beaaf1aff req-5a3b9530-0f04-4a9b-9c85-bb932139d67c tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1862791 Nov 18 21:03:49.865874 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-a3433e99-f207-48d8-890e-076e0995553b service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2615767 Nov 18 21:03:49.936651 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0060184-dccb-464e-9e9f-4e595a560343 req-84e9a36b-a7b1-48c3-a5bb-006d07d8aa8d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.939187 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b0060184-dccb-464e-9e9f-4e595a560343 req-84e9a36b-a7b1-48c3-a5bb-006d07d8aa8d service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1099 time: 0.1460614 Nov 18 21:03:49.960053 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4d9b61c-fb34-47dd-a0e6-59ea502bc158 req-bf30560c-68d4-4239-a442-63a05c0ec768 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:49.961754 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d4d9b61c-fb34-47dd-a0e6-59ea502bc158 req-bf30560c-68d4-4239-a442-63a05c0ec768 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0910723 Nov 18 21:03:50.072022 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b0060184-dccb-464e-9e9f-4e595a560343 req-efa4bff8-b927-4f0d-a663-eee645c02ac3 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1088202 Nov 18 21:03:50.080802 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-617412ff-ab63-4fc9-8b82-10da5d1e628e req-d7e9fda7-c927-4699-b8e5-f414e2c7ad6c service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1906407 Nov 18 21:03:50.096404 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d4d9b61c-fb34-47dd-a0e6-59ea502bc158 req-161f4125-eb1d-435b-a6c7-59197935f384 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1148319 Nov 18 21:03:50.281918 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1c1b3729-7a7f-4f76-8231-21e3f1b9900c req-c42838ff-1879-4457-8965-b9aa53acd403 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 210 time: 0.0440586 Nov 18 21:03:50.446157 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4134fde8-58c2-4605-afec-291f711abae3 req-027a5e95-2f53-4798-ac14-a431fc6db034 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:50.448935 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4134fde8-58c2-4605-afec-291f711abae3 req-027a5e95-2f53-4798-ac14-a431fc6db034 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0976892 Nov 18 21:03:50.628844 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-b18cbfb7-3c9e-4af0-b649-d4245ee3c17b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:50.632025 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-b18cbfb7-3c9e-4af0-b649-d4245ee3c17b service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.1397450 Nov 18 21:03:50.650556 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4134fde8-58c2-4605-afec-291f711abae3 req-9aae7817-c9a0-449e-ac17-2b2f6571ce10 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1861682 Nov 18 21:03:50.735086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:03:50.772828 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-633d4f83-eab0-4325-b6b1-6329d436f598 req-d5db1737-dd6f-4916-a3de-c3e9ec364a6c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:50.782054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-633d4f83-eab0-4325-b6b1-6329d436f598 req-d5db1737-dd6f-4916-a3de-c3e9ec364a6c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 946 time: 0.1565011 Nov 18 21:03:50.983628 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-dd0133f6-a972-4fd9-805c-328feb90f02b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:50.986402 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-dd0133f6-a972-4fd9-805c-328feb90f02b service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 0.3248610 Nov 18 21:03:51.071374 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:51.096955 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-5bd610bc-398a-409f-bcff-0383abd8628e tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:51.099149 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-5bd610bc-398a-409f-bcff-0383abd8628e tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.1132476 Nov 18 21:03:51.124220 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-625ec24a-3cf7-4040-883d-67a13f7b6d18 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 217 time: 0.1223004 Nov 18 21:03:51.205076 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:51.224190 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:51.277032 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-633d4f83-eab0-4325-b6b1-6329d436f598 req-c88bbda9-a42a-41d9-b663-b6818b163055 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4904690 Nov 18 21:03:51.317445 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-442a5196-a756-4bfe-af28-94c2ad5aa38c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:51.321351 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:51.321879 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-442a5196-a756-4bfe-af28-94c2ad5aa38c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 814 time: 0.5312905 Nov 18 21:03:51.324613 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9b04965-51a3-4383-8534-9a57ef8a33aa" -d '{"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-unplugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:51.332248 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=8']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:51.353351 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Request body: {'port': {'device_id': 'b5947bb8-5332-4306-992c-c2051380d339', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'admin_state_up': True, 'tenant_id': '05431e285025437d8783475290b4e4fc'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:51.383155 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16fc92b5-0215-4d87-b8a5-7c63a0100b2c req-4ddaab06-bc8d-4db1-904e-d8cad770a9d2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:51.386759 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-16fc92b5-0215-4d87-b8a5-7c63a0100b2c req-4ddaab06-bc8d-4db1-904e-d8cad770a9d2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 946 time: 0.3579664 Nov 18 21:03:51.391941 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-72a8e35f-a086-43af-8b4a-ca8c971d1d26 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:51.394789 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-72a8e35f-a086-43af-8b4a-ca8c971d1d26 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.2304604 Nov 18 21:03:51.459610 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-877d5ce5-5783-455f-876d-e9ef53915d87 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0373480 Nov 18 21:03:51.559461 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Deleting port 38d48d8e-6aab-43ea-b759-b7146853cbce {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:03:51.559816 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:51.599661 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-16fc92b5-0215-4d87-b8a5-7c63a0100b2c req-87629b54-4ce0-40db-a578-04a7a0b9607e tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/security-groups?id=d7355816-4070-4155-99bc-14b88fcea03e&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2008626 Nov 18 21:03:51.683574 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-0443359c-c476-47dd-9f22-ea4af791d605 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2120233 Nov 18 21:03:51.702963 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c5c3685-b647-4c88-817d-32535ebdc2f1 req-28ab3e4d-63df-4e22-ba84-086c2adcee64 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:51.703530 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7da9bc40-95f6-44d0-9980-972e1f0a7e75 x-openstack-request-id: req-7da9bc40-95f6-44d0-9980-972e1f0a7e75 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:51.704290 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-unplugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:51.704915 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-7da9bc40-95f6-44d0-9980-972e1f0a7e75 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:51.705428 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1c5c3685-b647-4c88-817d-32535ebdc2f1 req-28ab3e4d-63df-4e22-ba84-086c2adcee64 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.2359352 Nov 18 21:03:51.706049 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'code': 200} Nov 18 21:03:51.711955 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Made reservation on behalf of 05431e285025437d8783475290b4e4fc for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:03:51.717876 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:51.875728 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6e2345a9-aec8-4094-a912-2c169205ce3f req-9b5e362c-1a3a-4571-9204-5702ed766b3c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 210 time: 0.0350676 Nov 18 21:03:51.970461 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-359ab7b5-ce69-4dc3-9655-efd320d2cb0e service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2506859 Nov 18 21:03:52.130566 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33e5fb3b-bd4a-4ce2-9cd0-7ad193d5869a req-a049bcf1-ed21-41c3-882a-ae8682bec1b9 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:52.137443 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-33e5fb3b-bd4a-4ce2-9cd0-7ad193d5869a req-a049bcf1-ed21-41c3-882a-ae8682bec1b9 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1378396 Nov 18 21:03:52.198339 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] For port 38d48d8e-6aab-43ea-b759-b7146853cbce, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=38d48d8e-6aab-43ea-b759-b7146853cbce,segment=NetworkSegment(a71d8294-97d3-4004-81eb-f3aa0b67272e),segment_id=a71d8294-97d3-4004-81eb-f3aa0b67272e)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:03:52.199082 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:52.223700 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-33e5fb3b-bd4a-4ce2-9cd0-7ad193d5869a req-8602c653-0afe-4d88-918b-cf95e5eb90b6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0835435 Nov 18 21:03:52.303791 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1c5c3685-b647-4c88-817d-32535ebdc2f1 req-c1b230f6-22b8-4e8c-9c3f-c24c0f165e09 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.5812206 Nov 18 21:03:52.304936 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Calling delete_port for 38d48d8e-6aab-43ea-b759-b7146853cbce owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:03:52.505921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Allocated IP 172.20.0.13 (2d6a6844-15e6-4a14-9103-24e890fa190f/fcebaf13-b181-404f-a8e5-52ddbe0c8c7c/e06513e6-121c-46e8-849f-16261f3ab3f8) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:03:52.612738 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b1bdaf7-f374-44fe-95e9-0952d730c294 req-5498f5c3-2138-47a6-b29d-6c9cbc0d9699 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:52.616486 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1b1bdaf7-f374-44fe-95e9-0952d730c294 req-5498f5c3-2138-47a6-b29d-6c9cbc0d9699 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1393993 Nov 18 21:03:52.757926 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:52.761590 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1b1bdaf7-f374-44fe-95e9-0952d730c294 req-01f3ff18-22d7-4743-a5b3-842002cf26bc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1279128 Nov 18 21:03:52.780322 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['38d48d8e-6aab-43ea-b759-b7146853cbce'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:52.884182 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Pushing event deleted for resources: {'Port': ['ID=38d48d8e-6aab-43ea-b759-b7146853cbce,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:52.928508 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ba9d368c-fd98-43e6-8bb1-5edce07d2b4e req-4441fc84-4255-46e0-9593-f92997ce7bc5 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.1340172 Nov 18 21:03:52.980084 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] No DVR routers for this DVR port 38d48d8e-6aab-43ea-b759-b7146853cbce on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:03:52.990608 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:52.996343 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0b298b04-bee0-42fc-8ef0-74e9bebed241 req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.62 "DELETE /v2.0/ports/38d48d8e-6aab-43ea-b759-b7146853cbce HTTP/1.1" status: 204 len: 173 time: 1.8627205 Nov 18 21:03:52.998558 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:52.999108 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.000143 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.000724 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.001536 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.002294 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.007517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.007517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.007517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.007517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.007517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.007517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-16b1a100-71a8-4fa5-862b-673600af34c2 tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:53.012533 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'name': 'network-vif-deleted', 'tag': '38d48d8e-6aab-43ea-b759-b7146853cbce'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:53.016446 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-526aaebc-e0da-4d9f-a0a2-81d7599b420d" -d '{"events": [{"server_uuid": "26739f4f-1d65-438e-8da7-4d8e0b65e5bc", "name": "network-vif-deleted", "tag": "38d48d8e-6aab-43ea-b759-b7146853cbce"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:53.091707 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a6d0c41-3a88-4ea5-8dbd-9378f4329ece req-f6ff80b6-beb7-474f-9fff-0a1c1f0c762a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 210 time: 0.0888963 Nov 18 21:03:53.097780 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:53.153240 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a8c1e3c6-5254-4997-ad79-1ab4b78cb007 x-openstack-request-id: req-a8c1e3c6-5254-4997-ad79-1ab4b78cb007 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:53.153634 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "26739f4f-1d65-438e-8da7-4d8e0b65e5bc", "name": "network-vif-deleted", "tag": "38d48d8e-6aab-43ea-b759-b7146853cbce", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:53.154056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a8c1e3c6-5254-4997-ad79-1ab4b78cb007 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:53.154661 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '26739f4f-1d65-438e-8da7-4d8e0b65e5bc', 'name': 'network-vif-deleted', 'tag': '38d48d8e-6aab-43ea-b759-b7146853cbce', 'status': 'completed', 'code': 200} Nov 18 21:03:53.167175 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64905465-a062-4dcf-a391-a02470863423 req-1fabc8bb-acbb-47fa-beeb-560d7df33a75 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:53.169071 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-1fabc8bb-acbb-47fa-beeb-560d7df33a75 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.1366901 Nov 18 21:03:53.207076 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:53.230752 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77', '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:03:53.328172 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Network 2d6a6844-15e6-4a14-9103-24e890fa190f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:03:53.359251 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:03:53.381260 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:03:53.479056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event updated for resources: {'Port': ['ID=e06513e6-121c-46e8-849f-16261f3ab3f8,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:53.559957 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:53.560691 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:53.590358 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf67e414-8323-4a9e-b482-3f0673411a4a req-61dd7aaf-8bdf-491d-a6cd-f334fd5f622d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:53.593350 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf67e414-8323-4a9e-b482-3f0673411a4a req-61dd7aaf-8bdf-491d-a6cd-f334fd5f622d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1627574 Nov 18 21:03:53.652727 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64905465-a062-4dcf-a391-a02470863423 req-f46363fa-d24e-411b-afbc-7ba97f2b7bd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:53.655584 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-f46363fa-d24e-411b-afbc-7ba97f2b7bd0 service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 0.4188721 Nov 18 21:03:53.662412 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-148fe3d3-1c3a-4f2e-96e6-5a2488e0746f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 2.3201449 Nov 18 21:03:53.691381 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bedf350-ceae-4aaa-ac6e-7fdc7a484e7c req-1b31986f-fc6d-460e-8c8a-35f385740c21 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:53.696898 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0bedf350-ceae-4aaa-ac6e-7fdc7a484e7c req-1b31986f-fc6d-460e-8c8a-35f385740c21 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.1529415 Nov 18 21:03:53.719295 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Request body: {'port': {'device_id': 'b5947bb8-5332-4306-992c-c2051380d339', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:53.739389 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf67e414-8323-4a9e-b482-3f0673411a4a req-90886f70-282b-4c0f-aa4d-c172b6602ebf tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1349695 Nov 18 21:03:53.821214 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-cb0f63d8-7d2c-485a-8f73-305f8b99b24b service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 217 time: 0.1228025 Nov 18 21:03:53.964468 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37436) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:53.975551 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0bedf350-ceae-4aaa-ac6e-7fdc7a484e7c req-0341feef-4531-4ec7-9d78-e5b2478bc90d tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.2630177 Nov 18 21:03:53.986416 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:53.998997 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b8e68114-0501-450d-9d41-088845772faa req-11fc39d9-b02e-4bfb-ab84-294dc3c9de31 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:53.998997 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b8e68114-0501-450d-9d41-088845772faa req-11fc39d9-b02e-4bfb-ab84-294dc3c9de31 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0886185 Nov 18 21:03:54.030568 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64905465-a062-4dcf-a391-a02470863423 req-b5ea7418-8854-4fcc-8931-6385df7150e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:54.035847 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-b5ea7418-8854-4fcc-8931-6385df7150e5 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.1887805 Nov 18 21:03:54.116935 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b8e68114-0501-450d-9d41-088845772faa req-f5880b95-55c6-4183-88cd-c4c326308882 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1001611 Nov 18 21:03:54.194148 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-01c7a20c-a064-4d97-af23-a574ea3d2761 req-58f692f4-69a3-466e-9d3e-8ca21806f60b tempest-VolumesActionsTest-2054492782 tempest-VolumesActionsTest-2054492782-project] 10.222.0.61 "GET /v2.0/ports?device_id=26739f4f-1d65-438e-8da7-4d8e0b65e5bc HTTP/1.1" status: 200 len: 210 time: 0.1186337 Nov 18 21:03:54.200511 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-98705bd7-2d31-4343-9b1b-7687342024e2 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1263230 Nov 18 21:03:54.379116 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-8c67d98e-e193-4f67-90f2-c02417ee8a99 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1bae44277cb14f78954b8d5cb5e72988&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4130409 Nov 18 21:03:54.383204 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37448) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:54.450856 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5cffd04a-1adc-494c-8c35-e7984acc952e req-d8a1b3da-31ad-46f8-b975-75e786c84e99 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:54.452506 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5cffd04a-1adc-494c-8c35-e7984acc952e req-d8a1b3da-31ad-46f8-b975-75e786c84e99 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.1327527 Nov 18 21:03:54.502986 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:54.547464 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:54.560378 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5cffd04a-1adc-494c-8c35-e7984acc952e req-1afdda17-6d0e-48fc-b23b-b8fff1a213d9 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0995879 Nov 18 21:03:54.586594 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37454) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:54.638334 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe31f366-610c-4845-a3a5-f983ccbb40f9 req-831a8d03-28d6-4094-9aa9-e3db8af11d47 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:54.641662 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fe31f366-610c-4845-a3a5-f983ccbb40f9 req-831a8d03-28d6-4094-9aa9-e3db8af11d47 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 932 time: 0.2443385 Nov 18 21:03:54.649087 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-3d8526dd-d97f-4eaa-b5db-2bc91b170fed service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4291081 Nov 18 21:03:54.671814 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:54.677759 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:54.683558 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/21e31e1c-e685-4f8e-ab5c-f14f102db6f3 HTTP/1.1" status: 204 len: 168 time: 0.2950323 Nov 18 21:03:54.696382 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=21e31e1c-e685-4f8e-ab5c-f14f102db6f3,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:54.711604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.712210 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.712754 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.713327 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.715226 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.715794 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.716310 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.716832 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.717325 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.717881 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.718444 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.718997 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-31a5b946-2a3f-4350-b224-6afac417944c admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:03:54.770388 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 38d48d8e-6aab-43ea-b759-b7146853cbce no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:03:54.825364 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0edb2c23-5e8e-4a5a-b651-78c5d02efcee tempest-TestShelveInstance-821667374 tempest-TestShelveInstance-821667374-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:54.826565 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0edb2c23-5e8e-4a5a-b651-78c5d02efcee tempest-TestShelveInstance-821667374 tempest-TestShelveInstance-821667374-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1094 time: 0.2383091 Nov 18 21:03:54.828887 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 38d48d8e-6aab-43ea-b759-b7146853cbce {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:03:54.829351 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 38d48d8e-6aab-43ea-b759-b7146853cbce not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:03:54.837574 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37464) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:54.847454 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'port_id': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'fixed_ip_address': '172.20.0.10'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:54.936181 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for floatingip, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.027026 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-fe31f366-610c-4845-a3a5-f983ccbb40f9 req-f3d26de9-92c9-4cd6-9b58-df52d59e07a3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3369176 Nov 18 21:03:55.076157 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64905465-a062-4dcf-a391-a02470863423 req-635beac1-5182-4400-b03e-61f153726674 service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4086759 Nov 18 21:03:55.103824 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id e06513e6-121c-46e8-849f-16261f3ab3f8 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:03:55.122204 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.136351 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8691f929-f979-431b-8d6a-aee4da68d615 req-87252062-ad1d-4a89-991b-0047991e510a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:55.139700 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8691f929-f979-431b-8d6a-aee4da68d615 req-87252062-ad1d-4a89-991b-0047991e510a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2281480 Nov 18 21:03:55.163022 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Transition to ACTIVE for port object e06513e6-121c-46e8-849f-16261f3ab3f8 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:03:55.174598 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.260882 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8691f929-f979-431b-8d6a-aee4da68d615 req-07465c40-457f-4a9f-aa73-9b077ad0b69c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1047800 Nov 18 21:03:55.295887 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Pushing event updated for resources: {'Port': ['ID=e06513e6-121c-46e8-849f-16261f3ab3f8,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:55.338511 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.457125 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a745bb57-1d98-41de-9705-bff97c36c608 req-abac7e2f-2021-4dbe-b5ac-e56a9780be71 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:55.458794 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a745bb57-1d98-41de-9705-bff97c36c608 req-abac7e2f-2021-4dbe-b5ac-e56a9780be71 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0977366 Nov 18 21:03:55.459785 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Attempting to bind port e06513e6-121c-46e8-849f-16261f3ab3f8 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:03:55.460158 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Attempting to bind port e06513e6-121c-46e8-849f-16261f3ab3f8 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:03:55.460494 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Attempting to bind port e06513e6-121c-46e8-849f-16261f3ab3f8 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:55.465965 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Port e06513e6-121c-46e8-849f-16261f3ab3f8 on network 2d6a6844-15e6-4a14-9103-24e890fa190f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:03:55.466441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Attempting to bind port e06513e6-121c-46e8-849f-16261f3ab3f8 on network 2d6a6844-15e6-4a14-9103-24e890fa190f {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:03:55.474197 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 3, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:03:55.474624 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Checking segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:03:55.475081 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Bound using segment: {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:03:55.476146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Bound port: e06513e6-121c-46e8-849f-16261f3ab3f8, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '26679146-5e5a-421c-8b63-f1f783adcc41', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 604, 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:03:55.476598 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.658354 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Allocated IP 172.27.3.169 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/318132e8-efe9-440d-beb6-c1172232a741) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:03:55.719788 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a745bb57-1d98-41de-9705-bff97c36c608 req-07390325-e8ee-4959-8729-eb049a6118f8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2378449 Nov 18 21:03:55.740997 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] For port e06513e6-121c-46e8-849f-16261f3ab3f8, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:03:55.747712 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] For port e06513e6-121c-46e8-849f-16261f3ab3f8, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e06513e6-121c-46e8-849f-16261f3ab3f8,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:03:55.756082 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.827987 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:55.833579 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.839757 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] 10.222.0.62 "PUT /v2.0/ports/e06513e6-121c-46e8-849f-16261f3ab3f8 HTTP/1.1" status: 200 len: 1094 time: 2.1292520 Nov 18 21:03:55.840514 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5947bb8-5332-4306-992c-c2051380d339', 'tag': 'e06513e6-121c-46e8-849f-16261f3ab3f8'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:55.843691 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-85aa1b1f-5a4b-478b-996d-a47ad9111d36" -d '{"events": [{"name": "network-changed", "server_uuid": "b5947bb8-5332-4306-992c-c2051380d339", "tag": "e06513e6-121c-46e8-849f-16261f3ab3f8"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:55.893189 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:55.927780 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03846755-8463-4d08-8b8e-dc8e225dc59c service neutron] Pushing event updated for resources: {'Port': ['ID=e06513e6-121c-46e8-849f-16261f3ab3f8,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:55.946596 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-577c7658-eed2-4e2c-bc97-c017f9f2f50b x-openstack-request-id: req-577c7658-eed2-4e2c-bc97-c017f9f2f50b {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:55.947169 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5947bb8-5332-4306-992c-c2051380d339", "tag": "e06513e6-121c-46e8-849f-16261f3ab3f8", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:55.947500 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-577c7658-eed2-4e2c-bc97-c017f9f2f50b {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:55.948165 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5947bb8-5332-4306-992c-c2051380d339', 'tag': 'e06513e6-121c-46e8-849f-16261f3ab3f8', 'status': 'completed', 'code': 200} Nov 18 21:03:55.968295 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:56.065636 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-4bd6c446-09a1-4e39-bea5-41499fb0e576 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:56.068809 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-4bd6c446-09a1-4e39-bea5-41499fb0e576 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 1097 time: 0.0938485 Nov 18 21:03:56.160355 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-cb4e96da-d61a-4d0d-9680-cafe1f00de82 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e06513e6-121c-46e8-849f-16261f3ab3f8 HTTP/1.1" status: 200 len: 217 time: 0.0786486 Nov 18 21:03:56.229376 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:03:56.233067 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:03:56.237810 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:03:56.285625 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'Port': ['ID=318132e8-efe9-440d-beb6-c1172232a741,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:56.313364 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-f5b05664-f5d5-4e20-9fd7-f7b93a7002bb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:56.317486 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-f5b05664-f5d5-4e20-9fd7-f7b93a7002bb service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.1340706 Nov 18 21:03:56.339060 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d03ef17b-91f8-4e23-abbc-066311995e5d req-ab128fc1-a861-4c70-aad1-3a354345e1be tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:56.341266 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d03ef17b-91f8-4e23-abbc-066311995e5d req-ab128fc1-a861-4c70-aad1-3a354345e1be tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 944 time: 0.1769688 Nov 18 21:03:56.402988 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-fe7f0362-1748-41ab-b9e6-6cc62a47f635 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0475154 Nov 18 21:03:56.566797 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d03ef17b-91f8-4e23-abbc-066311995e5d req-ca756e7d-c22f-4377-a8f2-203b2b47c6e5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1676445 Nov 18 21:03:56.600831 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05c64638-2a95-414e-82ea-7273d03a98a0 req-cda2709f-96f1-43c1-87eb-940b3ce302a2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:56.605267 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-05c64638-2a95-414e-82ea-7273d03a98a0 req-cda2709f-96f1-43c1-87eb-940b3ce302a2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1732335 Nov 18 21:03:56.631081 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-024ac262-b38b-409e-96d6-2b3e3e4a00ab service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2169247 Nov 18 21:03:56.762237 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:03:56.766171 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-05c64638-2a95-414e-82ea-7273d03a98a0 req-2a0eba89-ea54-4c9e-8dc4-a4bb58a1570b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1169391 Nov 18 21:03:56.875297 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1d7f983-fdb8-49b4-969e-75f5fc6c5700 req-dbc15efb-7eba-4090-a027-c34c9c1da8ee service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2211864 Nov 18 21:03:57.054505 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f07e3e5-070f-49a6-b3e7-bb5d06ad71a7 req-6a855b04-2b88-4603-99a1-c4a46bb8fc76 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:57.056426 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0f07e3e5-070f-49a6-b3e7-bb5d06ad71a7 req-6a855b04-2b88-4603-99a1-c4a46bb8fc76 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1492648 Nov 18 21:03:57.065329 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-edbdb651-b8e4-4b8d-94a6-05dc834ecb32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:57.067552 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-edbdb651-b8e4-4b8d-94a6-05dc834ecb32 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05431e285025437d8783475290b4e4fc&device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 1097 time: 0.0931993 Nov 18 21:03:57.240978 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0f07e3e5-070f-49a6-b3e7-bb5d06ad71a7 req-3686016d-0d88-42e7-ae19-cc6d022bdb54 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1701591 Nov 18 21:03:57.295934 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:57.299993 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-8589983a-918d-44d8-a347-5f7005d033fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:57.302687 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-8589983a-918d-44d8-a347-5f7005d033fe service neutron] 10.222.0.62 "GET /v2.0/networks?id=2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 200 len: 915 time: 0.2010856 Nov 18 21:03:57.406366 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-4fb6f562-e1d8-4e31-b40b-6229f92c6f27 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=e06513e6-121c-46e8-849f-16261f3ab3f8 HTTP/1.1" status: 200 len: 217 time: 0.0764635 Nov 18 21:03:57.474852 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:57.504247 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-e93e978b-7020-4adf-9d31-4d606ec7807d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:57.506794 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-e93e978b-7020-4adf-9d31-4d606ec7807d service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 200 len: 854 time: 0.0868261 Nov 18 21:03:57.568998 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-fa178399-7f1c-4def-873d-9568ffff0dbd service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=2d6a6844-15e6-4a14-9103-24e890fa190f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0490510 Nov 18 21:03:57.734572 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:57.742593 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:57.801829 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b293c52a-cad9-4855-8a65-64694c752b05 req-eb3d9cad-e0b6-4bce-b8c4-4c0beb4f0679 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:57.818146 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b293c52a-cad9-4855-8a65-64694c752b05 req-eb3d9cad-e0b6-4bce-b8c4-4c0beb4f0679 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 944 time: 0.1249955 Nov 18 21:03:57.889225 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b293c52a-cad9-4855-8a65-64694c752b05 req-a22c3976-6bda-45dd-9146-bbf0db6f9424 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0694101 Nov 18 21:03:57.952524 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event updated for resources: {'Port': ['ID=318132e8-efe9-440d-beb6-c1172232a741,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:58.000932 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:58.083570 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d802ec3-cd81-49ee-bcd0-a729d708c950 req-784f8ef2-b462-4fa7-aa2f-c7a3ddf719b4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:58.085155 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0d802ec3-cd81-49ee-bcd0-a729d708c950 req-784f8ef2-b462-4fa7-aa2f-c7a3ddf719b4 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1850367 Nov 18 21:03:58.094418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [req-d1db30c3-cd96-401b-bd17-940b27899def req-55a623f1-797a-4f75-af8f-a0d1aa02bb07 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:03:58.097000 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d1db30c3-cd96-401b-bd17-940b27899def req-55a623f1-797a-4f75-af8f-a0d1aa02bb07 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0090265 Nov 18 21:03:58.208159 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.l3_db [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Floating IP e5b8911c-f58a-4b7c-a107-4e41d41f6b35 associated. External IP: 172.27.3.169, port: 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072. Nov 18 21:03:58.226133 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0d802ec3-cd81-49ee-bcd0-a729d708c950 req-a5252f62-764f-478b-8174-f8bf7a99e60b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991838 Nov 18 21:03:58.383390 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-209c932e-e006-4f6b-9da0-cc8f4fde62e8 req-d0600626-cb2f-406c-8013-0dfd5776e928 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:58.386225 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-209c932e-e006-4f6b-9da0-cc8f4fde62e8 req-d0600626-cb2f-406c-8013-0dfd5776e928 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.1118572 Nov 18 21:03:58.472216 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-209c932e-e006-4f6b-9da0-cc8f4fde62e8 req-8a1b4bf4-f054-4cd5-8eb2-ea82e939ce36 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0757539 Nov 18 21:03:58.514315 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 37582) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:58.514597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-709bc207-ffed-4bff-a465-5312d69ab7c2 req-9e2ca8b1-3270-4ece-bdb9-d8e1af0cee99 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:58.516957 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-709bc207-ffed-4bff-a465-5312d69ab7c2 req-9e2ca8b1-3270-4ece-bdb9-d8e1af0cee99 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1184120 Nov 18 21:03:58.748985 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-709bc207-ffed-4bff-a465-5312d69ab7c2 req-e9471282-86bf-41a5-a06b-f6d073ce2564 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2188153 Nov 18 21:03:58.781722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:03:58.858868 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-c3c78426-ee96-4d10-8e2c-2d0722b3fc8d tempest-TestMinimumBasicScenario-1386556053 tempest-TestMinimumBasicScenario-1386556053-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:58.864275 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c3c78426-ee96-4d10-8e2c-2d0722b3fc8d tempest-TestMinimumBasicScenario-1386556053 tempest-TestMinimumBasicScenario-1386556053-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1093 time: 0.3469546 Nov 18 21:03:58.867673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 37594) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:58.875047 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'port_id': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'fixed_ip_address': '172.20.0.5'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:03:58.913682 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for floatingip, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:58.924997 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 37598) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:03:58.986070 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:03:59.004265 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] Sync routers for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:03:59.033961 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:03:59.034885 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:03:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:03:59.052348 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:59.116162 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-4e79e64e-6e01-4ab6-bc79-9ff4e7e527de tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 4.2651148 Nov 18 21:03:59.116162 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:03:59.116162 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-dd24fb33-ab07-4491-be72-99b7d64c36e9" -d '{"events": [{"name": "network-changed", "server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:03:59.116852 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62dac773-a841-4292-9035-f58be3359497 req-b1521fa8-5205-493c-ac97-a2046761134f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:59.125067 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-62dac773-a841-4292-9035-f58be3359497 req-b1521fa8-5205-493c-ac97-a2046761134f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 944 time: 0.1182883 Nov 18 21:03:59.165113 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-e256ba81-3c7e-4bf4-b266-f4ae0bf6e882 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.2381566 Nov 18 21:03:59.175504 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-1329abbd-b096-4370-8eab-7a5b82125b85 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:03:59.177200 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-1329abbd-b096-4370-8eab-7a5b82125b85 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0109246 Nov 18 21:03:59.201948 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:03:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7d13179f-8346-4b26-9794-53934feb5731 x-openstack-request-id: req-7d13179f-8346-4b26-9794-53934feb5731 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:03:59.202247 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:03:59.202506 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-7d13179f-8346-4b26-9794-53934feb5731 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:03:59.202916 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'status': 'completed', 'code': 200} Nov 18 21:03:59.246373 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-62dac773-a841-4292-9035-f58be3359497 req-9291980d-a366-413c-b727-41ba149fb616 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1199863 Nov 18 21:03:59.279294 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:03:59.307029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:59.498649 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c51071a-2c41-4937-9e4b-cc44dd0739a2 req-08260d42-1b19-4206-ad24-ccddf149453a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:03:59.500862 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2c51071a-2c41-4937-9e4b-cc44dd0739a2 req-08260d42-1b19-4206-ad24-ccddf149453a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1125782 Nov 18 21:03:59.529646 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Allocated IP 172.27.3.76 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/661b4b72-77cf-4ae4-9921-4acc0e15baeb) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:03:59.619669 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2c51071a-2c41-4937-9e4b-cc44dd0739a2 req-50dddc4d-c741-4519-ba12-294efe067c49 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1061125 Nov 18 21:03:59.715250 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'e5b8911c-f58a-4b7c-a107-4e41d41f6b35', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'floating_ip_address': '172.27.3.169', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'port_id': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'mac_address': 'fa:16:3e:e3:7b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:03:56Z', 'updated_at': '2021-11-18T21:03:56Z', 'revision_number': 0, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:24Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:03:59.759170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:59.768405 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] Checking router: 7ff3c29a-4ec9-401d-888e-f0fe474fba95 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:03:59.784468 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:03:59.785653 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:03:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:03:59.827921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:03:59.907878 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:03:59.927710 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:03:59.936624 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:03:59.942199 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'Port': ['ID=661b4b72-77cf-4ae4-9921-4acc0e15baeb,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:03:59.980662 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:04:00.001734 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62c51fbb-16e7-4521-91c6-a0a140043e6d req-63bab681-ae29-46d8-920d-8a8bfefa5e3e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:00.004046 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-62c51fbb-16e7-4521-91c6-a0a140043e6d req-63bab681-ae29-46d8-920d-8a8bfefa5e3e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1222045 Nov 18 21:04:00.203721 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-62c51fbb-16e7-4521-91c6-a0a140043e6d req-fec6af1d-7b37-4348-a298-70cd128aa4f7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1557689 Nov 18 21:04:00.382516 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'e5b8911c-f58a-4b7c-a107-4e41d41f6b35', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'floating_ip_address': '172.27.3.169', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'port_id': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'mac_address': 'fa:16:3e:e3:7b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:03:56Z', 'updated_at': '2021-11-18T21:03:56Z', 'revision_number': 0, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:24Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:00.418847 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd56e70c-6d04-4986-9730-5a3c428e801d req-df7b9584-2a62-499f-b408-cc9ffaae5cf4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:00.421465 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd56e70c-6d04-4986-9730-5a3c428e801d req-df7b9584-2a62-499f-b408-cc9ffaae5cf4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 944 time: 0.0690379 Nov 18 21:04:00.430403 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d65f1fa9-16a4-487d-b3ef-c75f50a87f74 None None] The sync data for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi is: [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'e5b8911c-f58a-4b7c-a107-4e41d41f6b35', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'floating_ip_address': '172.27.3.169', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'port_id': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 422, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'mac_address': 'fa:16:3e:e3:7b:9a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:03:56Z', 'updated_at': '2021-11-18T21:03:56Z', 'revision_number': 0, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:24Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:04:00.501437 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd56e70c-6d04-4986-9730-5a3c428e801d req-687db039-f7ae-44c3-a548-a6a8b7d7b424 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0697465 Nov 18 21:04:00.761538 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1c5d8ea-f7ae-45f0-95f7-9419c8444559 None None] New status for floating IP e5b8911c-f58a-4b7c-a107-4e41d41f6b35: ACTIVE {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:04:00.944804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-42341536-4ea6-420c-9776-e3d2f56121eb req-5c400158-93ad-4c1c-ad57-f3a5415d3628 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:00.947506 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-42341536-4ea6-420c-9776-e3d2f56121eb req-5c400158-93ad-4c1c-ad57-f3a5415d3628 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1123490 Nov 18 21:04:01.009237 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:01.074474 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-42341536-4ea6-420c-9776-e3d2f56121eb req-83501d5e-2dae-4785-a4b6-4dfa15af7fcd tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1128030 Nov 18 21:04:01.109364 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:01.288577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:01.294962 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:01.389231 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1997b364-187e-4505-99b4-6b887c1cbce0 req-085e8725-fa26-4377-a1eb-0113d54ed8e3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:01.391843 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1997b364-187e-4505-99b4-6b887c1cbce0 req-085e8725-fa26-4377-a1eb-0113d54ed8e3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0688353 Nov 18 21:04:01.408635 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'Port': ['ID=661b4b72-77cf-4ae4-9921-4acc0e15baeb,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:01.419811 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:01.469014 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1997b364-187e-4505-99b4-6b887c1cbce0 req-aa71c10c-18c8-41a0-897c-190a5eef3c88 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684245 Nov 18 21:04:01.558686 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Floating IP c82dd081-137c-40d3-9573-203c9f26552f associated. External IP: 172.27.3.76, port: e439a92d-6b32-4acc-93a3-91c54d8ca660. Nov 18 21:04:01.715851 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbbf25b5-4511-422f-aaac-19cd4ca12a0a req-e3c6c9f1-04e1-4411-84ed-aa65c87de13e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:01.717627 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dbbf25b5-4511-422f-aaac-19cd4ca12a0a req-e3c6c9f1-04e1-4411-84ed-aa65c87de13e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 944 time: 0.0722737 Nov 18 21:04:01.767818 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:04:02.081891 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dbbf25b5-4511-422f-aaac-19cd4ca12a0a req-eeb539d3-096a-4e34-808d-3a35b059a621 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3196084 Nov 18 21:04:02.092478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-603c6932-0237-4974-8817-585be1bac975 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:02.094887 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-603c6932-0237-4974-8817-585be1bac975 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1099 time: 0.3004477 Nov 18 21:04:02.130867 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Router 95e57f35-7985-470a-b802-3cb4e75797cd has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:04:02.182716 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-1b50a77d-b4d8-46e1-bb62-6c7f1d1ae48d service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4223633 Nov 18 21:04:02.202140 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9bd22cf2-970f-4929-9074-965b812a781c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:02.246501 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc7be3a6-9155-4f0b-a614-0529e63f3591 req-37d950d2-060e-45dc-9ca6-dbd273077bd7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:02.248715 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cc7be3a6-9155-4f0b-a614-0529e63f3591 req-37d950d2-060e-45dc-9ca6-dbd273077bd7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0672488 Nov 18 21:04:02.319059 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cc7be3a6-9155-4f0b-a614-0529e63f3591 req-4b2346c4-8f52-4525-baa5-c4f51875526c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0578265 Nov 18 21:04:02.451336 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-f1164c34-04b0-4613-bb85-8d8471525c96 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:02.452970 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-f1164c34-04b0-4613-bb85-8d8471525c96 service neutron] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 910 time: 0.3425484 Nov 18 21:04:02.463202 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-85aa1b1f-5a4b-478b-996d-a47ad9111d36 req-b02f1346-a839-4454-991e-c17bfd142afb service neutron] 10.222.0.62 "GET /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2584932 Nov 18 21:04:02.470026 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:04:02.482318 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] Sync routers for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:04:02.501511 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:04:02.503547 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:03:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:02.582346 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:02.660283 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:04:02.673828 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-ac3d97e1-38fa-4b25-9a50-40002b59176d service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 1002 time: 0.2001164 Nov 18 21:04:02.676998 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8f793644-5b3d-4b90-b952-aa3384659e2c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 3.8078349 Nov 18 21:04:02.678022 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:02.680533 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-46f2f3e4-3387-46e3-a003-e26db22e8f57" -d '{"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:02.682165 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37652) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:02.690195 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1716837952', 'description': 'tempest-secgroup-smoke-1716837952 description', 'project_id': '05d2b75b4995419da5138c25c602c16e'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:02.752893 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:02.770505 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dad669c3-2f7e-461d-8905-ecc4b254c464 req-3f8cabb7-aed3-49ba-a881-90f1d6ebd959 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:02.773361 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dad669c3-2f7e-461d-8905-ecc4b254c464 req-3f8cabb7-aed3-49ba-a881-90f1d6ebd959 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1826160 Nov 18 21:04:02.778803 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f4ab7a01-5659-4aec-a422-9c4b97bac5d1 x-openstack-request-id: req-f4ab7a01-5659-4aec-a422-9c4b97bac5d1 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:02.779274 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:02.779702 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f4ab7a01-5659-4aec-a422-9c4b97bac5d1 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:02.780396 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'status': 'completed', 'code': 200} Nov 18 21:04:02.900646 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:02.908606 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:02.916254 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-4a569968-5fca-442d-930d-5efea34464df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:02.918826 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-4a569968-5fca-442d-930d-5efea34464df service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.2239401 Nov 18 21:04:02.975161 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:02.977500 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.2934442 Nov 18 21:04:02.981480 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1573c175-a078-4840-9885-b536dfb2346f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroup': ['ID=503edafc-04c7-45d2-b641-984e7e555400,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:02.987028 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 37656) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:02.990969 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dad669c3-2f7e-461d-8905-ecc4b254c464 req-220163c6-6ad0-4d7b-9bc9-1ae67b6fb6d6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2016237 Nov 18 21:04:02.995603 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group_rule': {'security_group_id': '503edafc-04c7-45d2-b641-984e7e555400', 'project_id': '05d2b75b4995419da5138c25c602c16e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:03.006676 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-e7379b4d-186e-4e37-a648-e597433ef140 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:03.009333 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-e7379b4d-186e-4e37-a648-e597433ef140 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1098 time: 0.1802692 Nov 18 21:04:03.053378 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'c82dd081-137c-40d3-9573-203c9f26552f', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'floating_ip_address': '172.27.3.76', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'port_id': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'mac_address': 'fa:16:3e:ee:b9:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b87386c-a173-427d-a5e7-e1eec028652f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:04:00Z', 'updated_at': '2021-11-18T21:04:00Z', 'revision_number': 0, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:05Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:03.149952 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-34b5f5f9-d40e-4f27-98fd-9cea6188ae96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:03.152050 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-34b5f5f9-d40e-4f27-98fd-9cea6188ae96 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.2127848 Nov 18 21:04:03.190959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:03.219958 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] Checking router: 95e57f35-7985-470a-b802-3cb4e75797cd for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:04:03.241169 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:04:03.242280 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:03:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:03.319123 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0f68f5-c22a-4891-9dc9-ecf930fdc28d req-b17bc89a-d18a-4f3b-aa8f-e2ae2025f022 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:03.327406 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-aa0f68f5-c22a-4891-9dc9-ecf930fdc28d req-b17bc89a-d18a-4f3b-aa8f-e2ae2025f022 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 944 time: 0.1094115 Nov 18 21:04:03.381627 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-d8df78af-b14c-4b88-b5ab-0f7c59983b7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:03.384933 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-d8df78af-b14c-4b88-b5ab-0f7c59983b7d service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.3561313 Nov 18 21:04:03.421822 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-aa0f68f5-c22a-4891-9dc9-ecf930fdc28d req-854d613f-6b62-4b7d-a216-df1460174a1e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0848751 Nov 18 21:04:03.513251 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:04:03.770050 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e06513e6-121c-46e8-849f-16261f3ab3f8 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:04:03.815732 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:03.821963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-479d9c9a-937f-4657-912e-ab7e02f35747 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6494012 Nov 18 21:04:03.829280 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:03.845326 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-51ca9abc-7044-4481-a65f-c3fb56c51ca8 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 998 time: 0.4466476 Nov 18 21:04:03.860246 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'c82dd081-137c-40d3-9573-203c9f26552f', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'floating_ip_address': '172.27.3.76', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'port_id': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'mac_address': 'fa:16:3e:ee:b9:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b87386c-a173-427d-a5e7-e1eec028652f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:04:00Z', 'updated_at': '2021-11-18T21:04:00Z', 'revision_number': 0, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:05Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:03.885843 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b8722806-00e5-48b2-aa2c-ba284d35175d,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:03.905109 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-348c7edf-91ee-4831-a58a-009a74a3f12b None None] The sync data for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi is: [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'c82dd081-137c-40d3-9573-203c9f26552f', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'floating_ip_address': '172.27.3.76', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'port_id': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'fixed_ip_address': '172.20.0.5', 'status': 'DOWN', 'standard_attr_id': 424, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'mac_address': 'fa:16:3e:ee:b9:e9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6b87386c-a173-427d-a5e7-e1eec028652f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:04:00Z', 'updated_at': '2021-11-18T21:04:00Z', 'revision_number': 0, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:05Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:04:03.942343 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port e06513e6-121c-46e8-849f-16261f3ab3f8, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e06513e6-121c-46e8-849f-16261f3ab3f8,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:03.953791 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-acebb038-61f3-49f0-b66f-7670543b2856 req-4f15758d-3f9b-43c5-a67b-38a95f135665 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:03.956434 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-acebb038-61f3-49f0-b66f-7670543b2856 req-4f15758d-3f9b-43c5-a67b-38a95f135665 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.4745114 Nov 18 21:04:03.966838 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:03.968247 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-07ac04d8-d03d-44df-83b2-d28b0205170c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.9761672 Nov 18 21:04:03.973774 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37668) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:03.979911 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group_rule': {'security_group_id': '503edafc-04c7-45d2-b641-984e7e555400', 'project_id': '05d2b75b4995419da5138c25c602c16e', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:03.983038 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': 'e06513e6-121c-46e8-849f-16261f3ab3f8', 'network_id': '2d6a6844-15e6-4a14-9103-24e890fa190f', 'port_id': 'e06513e6-121c-46e8-849f-16261f3ab3f8', 'mac_address': 'fa:16:3e:7d:73:84', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 604, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fcebaf13-b181-404f-a8e5-52ddbe0c8c7c', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:04:04.035458 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.060390 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-b34e9f88-565c-4032-89d0-6eac1d5dda75 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:04.062596 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-b34e9f88-565c-4032-89d0-6eac1d5dda75 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.1988420 Nov 18 21:04:04.112389 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.152762 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd24fb33-ab07-4491-be72-99b7d64c36e9 req-d7b47657-6f62-482c-ba33-e3c6e6c6143b service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3115568 Nov 18 21:04:04.166639 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-acebb038-61f3-49f0-b66f-7670543b2856 req-2a2b4dfb-35c1-4a34-ac23-48a393702df2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1859183 Nov 18 21:04:04.183051 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id e06513e6-121c-46e8-849f-16261f3ab3f8 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:04:04.197418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-25066f9e-d7d8-4808-9407-ce9b4f6eecc6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:04.204007 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-25066f9e-d7d8-4808-9407-ce9b4f6eecc6 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1158924 Nov 18 21:04:04.255754 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port e06513e6-121c-46e8-849f-16261f3ab3f8, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e06513e6-121c-46e8-849f-16261f3ab3f8,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:04.276369 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.384629 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-13d015cf-9da1-4eb8-99ed-5870267a3778 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1580856 Nov 18 21:04:04.419587 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=e06513e6-121c-46e8-849f-16261f3ab3f8,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:04.433346 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.433918 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.434486 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.435223 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.435781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.436528 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.437086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.441359 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.441948 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.442505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.443229 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.443789 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:04.497803 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.525581 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5842d0b-3c60-4334-883e-32d24fc39f46 req-4810b10e-cacf-46be-beaf-9ec7bb78c340 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:04.527192 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e5842d0b-3c60-4334-883e-32d24fc39f46 req-4810b10e-cacf-46be-beaf-9ec7bb78c340 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.2427766 Nov 18 21:04:04.528254 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.537877 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4649a1aa-aa16-4954-bcdb-7287ce020c8c None None] New status for floating IP c82dd081-137c-40d3-9573-203c9f26552f: ACTIVE {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:04:04.579303 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-46f2f3e4-3387-46e3-a003-e26db22e8f57 req-10bf22b9-adc1-4dff-8e68-98e904726de9 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1792264 Nov 18 21:04:04.622893 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=005e7f78-19a4-4cac-bff3-e7dff0cb4a6f,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:04.718835 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.726266 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-798ccd18-a904-4065-8931-74d2808b230d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.7451632 Nov 18 21:04:04.726975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37690) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:04.732176 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group_rule': {'security_group_id': '503edafc-04c7-45d2-b641-984e7e555400', 'project_id': '05d2b75b4995419da5138c25c602c16e', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:04.743494 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e5842d0b-3c60-4334-883e-32d24fc39f46 req-46126589-57cc-4c37-a00e-641a7701b31e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1639223 Nov 18 21:04:04.760156 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7f4c105-2f80-42e6-8122-4a6f0a1188a9 req-b34d2499-1aef-46b6-a517-d8ed84fba35f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:04.761311 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c7f4c105-2f80-42e6-8122-4a6f0a1188a9 req-b34d2499-1aef-46b6-a517-d8ed84fba35f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 945 time: 0.1212435 Nov 18 21:04:04.791782 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:04.875575 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c7f4c105-2f80-42e6-8122-4a6f0a1188a9 req-0f5bd175-324a-470f-85dd-e972ee78bfa8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1015072 Nov 18 21:04:04.998940 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e06513e6-121c-46e8-849f-16261f3ab3f8'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:04:05.007087 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f1d7fcf4-42e6-439b-90c4-57a4b5ae61d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.388167 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.412564 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.475046 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.478491 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7507122 Nov 18 21:04:05.507381 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37704) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:05.531043 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group_rule': {'security_group_id': '503edafc-04c7-45d2-b641-984e7e555400', 'project_id': '05d2b75b4995419da5138c25c602c16e', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:05.566241 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68ecf20b-d40b-44e5-80df-7994340a2673 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=04be9dc7-25fe-4900-a4dd-f7dc6d2311b0,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:05.610617 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.654405 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-06c620e1-94ec-4714-8bbd-dd2ded39f57c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:05.661829 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-06c620e1-94ec-4714-8bbd-dd2ded39f57c service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb&tenant_id=d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 1097 time: 0.2704263 Nov 18 21:04:05.703038 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dbffd032-bd96-4121-832f-97494d0014a9 req-6ceadbe0-d135-4b89-b56f-0818142efcd7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:05.713552 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dbffd032-bd96-4121-832f-97494d0014a9 req-6ceadbe0-d135-4b89-b56f-0818142efcd7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2300601 Nov 18 21:04:05.764095 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.778583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-724b4b8f-5ad3-4bb5-8418-ed80466e3223 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:05.780846 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-724b4b8f-5ad3-4bb5-8418-ed80466e3223 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1097 time: 0.0752308 Nov 18 21:04:05.786904 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.882110 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=cc7fa343-cb8d-4924-9275-9e5befa25d5a,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:05.936506 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:05.946656 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7a6aa078-397a-431e-a7f0-8c833635f25f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.4364586 Nov 18 21:04:05.951545 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37710) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:05.982781 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group_rule': {'security_group_id': '503edafc-04c7-45d2-b641-984e7e555400', 'project_id': '05d2b75b4995419da5138c25c602c16e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:06.032133 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.038809 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-dbffd032-bd96-4121-832f-97494d0014a9 req-11f0eab1-85b3-4d51-9013-4a497c2c2d29 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3237891 Nov 18 21:04:06.040088 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.securitygroups_db [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Project 05d2b75b4995419da5138c25c602c16e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 21:04:06.048595 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.245109 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.255297 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.334787 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-684ce378-f92e-4c7a-b21e-18396e428ba6 req-e8c15798-c4a2-4a9b-92a3-ebd29e6c910f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:06.349029 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-684ce378-f92e-4c7a-b21e-18396e428ba6 req-e8c15798-c4a2-4a9b-92a3-ebd29e6c910f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.2464085 Nov 18 21:04:06.382493 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76e8790b-7e4b-43fa-84ed-f97c5a0e710c,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:06.405223 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.413158 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 37720) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:06.413503 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-d71ccf65-c380-4d14-9b71-fd87e2ff8a0d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.4507408 Nov 18 21:04:06.427608 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-684ce378-f92e-4c7a-b21e-18396e428ba6 req-830082cf-ce8b-453e-8fe6-8d03516c99ab tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0773242 Nov 18 21:04:06.432879 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b6b3188-be14-48d2-b5ae-9510c28d3263 req-6227ae64-4416-4008-b0da-d882f2e7d0f1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:06.443299 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'security_group_rule': {'security_group_id': '503edafc-04c7-45d2-b641-984e7e555400', 'project_id': '05d2b75b4995419da5138c25c602c16e', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:06.461194 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3b6b3188-be14-48d2-b5ae-9510c28d3263 req-6227ae64-4416-4008-b0da-d882f2e7d0f1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 945 time: 0.1906738 Nov 18 21:04:06.466230 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-fab48622-c0fe-471c-b8af-95100e982945 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:06.467884 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-fab48622-c0fe-471c-b8af-95100e982945 service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.6624753 Nov 18 21:04:06.522777 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.securitygroups_db [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Project 05d2b75b4995419da5138c25c602c16e added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 21:04:06.597825 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3b6b3188-be14-48d2-b5ae-9510c28d3263 req-f9ba8ae0-da1b-4c73-bb59-fb63cb28c2b1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1314592 Nov 18 21:04:06.604407 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.700710 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-6ae286f1-4129-4554-8acc-932927cb4383 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 200 len: 1000 time: 0.2002816 Nov 18 21:04:06.814281 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-d33ae983-4d89-42df-8987-145303cd8d43 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:06.814281 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-d33ae983-4d89-42df-8987-145303cd8d43 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0950158 Nov 18 21:04:06.904072 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.913569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.943577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=58e405cb-2860-4b77-bb04-f3aff6651a46,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:06.986651 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-de3ff37c-1a7a-47ca-815d-0aa6b028e77a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:06.989369 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-de3ff37c-1a7a-47ca-815d-0aa6b028e77a service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1430211 Nov 18 21:04:06.995863 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:06.999862 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-df39f289-09b8-41f0-88dd-4765fe5cc8c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.5687008 Nov 18 21:04:07.258458 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-346c8bc9-3465-4844-8f9a-6d83900fa010 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1716837952&fields=id&tenant_id=05d2b75b4995419da5138c25c602c16e HTTP/1.1" status: 200 len: 267 time: 0.1426027 Nov 18 21:04:07.343145 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-206fe44c-cc4f-4cde-bd0f-fce71cd12042 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3369672 Nov 18 21:04:07.525808 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a8a43cf7-5f91-440b-9d05-d02a22cb8413 req-d3d960ec-e739-4ff9-a042-3a3b9b0360e7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:07.528463 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a8a43cf7-5f91-440b-9d05-d02a22cb8413 req-d3d960ec-e739-4ff9-a042-3a3b9b0360e7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2510808 Nov 18 21:04:07.553171 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:07.646843 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a8a43cf7-5f91-440b-9d05-d02a22cb8413 req-9146237e-3aa6-4f52-9861-61b82dd6cdf1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1063151 Nov 18 21:04:07.685982 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-5aefc5c1-2f4a-4fca-b110-fd6e5d59ea1a tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:07.689367 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-5aefc5c1-2f4a-4fca-b110-fd6e5d59ea1a tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.3438725 Nov 18 21:04:07.717339 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'port': {'security_groups': ['eb79f9a0-0320-4d56-8fdc-62bf7176a220', '503edafc-04c7-45d2-b641-984e7e555400']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:07.763211 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-40db7a82-d90c-458b-8860-704f9e6e70e8 req-a5fdb07e-ee71-467e-887a-8cc4a74d4b9f service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3882847 Nov 18 21:04:07.779035 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e06513e6-121c-46e8-849f-16261f3ab3f8 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:04:07.873503 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:07.934265 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-78cf7fda-61f3-4546-8f3f-4ec9f86172a4 req-5b9ea0ec-3255-4359-b413-953535a34ed5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:07.953913 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-78cf7fda-61f3-4546-8f3f-4ec9f86172a4 req-5b9ea0ec-3255-4359-b413-953535a34ed5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1844077 Nov 18 21:04:07.999151 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port e06513e6-121c-46e8-849f-16261f3ab3f8 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:04:08.025155 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port e06513e6-121c-46e8-849f-16261f3ab3f8 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:04:08.026163 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.138579 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-78cf7fda-61f3-4546-8f3f-4ec9f86172a4 req-567f31ab-594d-4f8a-b5de-3c9ac28202df tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1793191 Nov 18 21:04:08.401565 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:08.440808 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.463267 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.473350 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.482056 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-331a5ead-e92b-4b33-a6bd-7dc740b23c05 req-2c0cf99a-213e-4087-a49f-788dffedf0f0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:08.482454 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.500866 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-331a5ead-e92b-4b33-a6bd-7dc740b23c05 req-2c0cf99a-213e-4087-a49f-788dffedf0f0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 945 time: 0.1838069 Nov 18 21:04:08.545222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e439a92d-6b32-4acc-93a3-91c54d8ca660'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:04:08.610317 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:08.611837 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.616739 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-614be045-e08e-4d9d-9314-d952b55d9ea6 req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "PUT /v2.0/ports/e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 981 time: 0.9093935 Nov 18 21:04:08.624002 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:08.635122 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745" -d '{"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:08.659175 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8641e456-f9f7-4dae-96f0-0e3b9694c493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=6']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:08.684293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5947bb8-5332-4306-992c-c2051380d339', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e06513e6-121c-46e8-849f-16261f3ab3f8'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:08.689348 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13571e5f-eac2-4e80-adb9-e28fcff38913" -d '{"events": [{"server_uuid": "b5947bb8-5332-4306-992c-c2051380d339", "name": "network-vif-plugged", "status": "completed", "tag": "e06513e6-121c-46e8-849f-16261f3ab3f8"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:08.711432 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-331a5ead-e92b-4b33-a6bd-7dc740b23c05 req-e5b5b0b2-0db9-449c-a6e1-6c677e940c87 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2016027 Nov 18 21:04:08.759712 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port e06513e6-121c-46e8-849f-16261f3ab3f8, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e06513e6-121c-46e8-849f-16261f3ab3f8,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:08.768213 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:08.876318 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-340122c8-bfa4-4a4b-b3ed-18e8ba42d06b x-openstack-request-id: req-340122c8-bfa4-4a4b-b3ed-18e8ba42d06b {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:08.877684 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:08.877684 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-340122c8-bfa4-4a4b-b3ed-18e8ba42d06b {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:08.878110 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'status': 'completed', 'code': 200} Nov 18 21:04:08.934467 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=e06513e6-121c-46e8-849f-16261f3ab3f8,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:08.959505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e439a92d-6b32-4acc-93a3-91c54d8ca660'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:04:09.076698 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458d31b2-94b1-4ac3-947d-0aba71d5bcdf req-39f9cc4c-229e-4073-8ece-108adc0bce39 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:09.101020 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458d31b2-94b1-4ac3-947d-0aba71d5bcdf req-39f9cc4c-229e-4073-8ece-108adc0bce39 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.2835939 Nov 18 21:04:09.169420 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b05cb816-93c6-4761-b1c0-5d2582e09c27 req-38b75af2-3cf6-4c8c-a9a9-45e04bda0d56 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:09.186059 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b05cb816-93c6-4761-b1c0-5d2582e09c27 req-38b75af2-3cf6-4c8c-a9a9-45e04bda0d56 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1803679 Nov 18 21:04:09.290976 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458d31b2-94b1-4ac3-947d-0aba71d5bcdf req-49fe70f3-0e37-491a-835c-62fec8773d3f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1851463 Nov 18 21:04:09.328271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-743797d8-f1ee-4928-96a7-245a9699cec0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:09.328271 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-743797d8-f1ee-4928-96a7-245a9699cec0 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1137 time: 0.4233525 Nov 18 21:04:09.370857 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b05cb816-93c6-4761-b1c0-5d2582e09c27 req-1dd729d0-d075-44c6-9f04-d12d9cb819d5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1802962 Nov 18 21:04:09.433804 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-509180dd-f8b1-4fa9-9bca-67857897723d x-openstack-request-id: req-509180dd-f8b1-4fa9-9bca-67857897723d {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:09.434140 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5947bb8-5332-4306-992c-c2051380d339", "name": "network-vif-plugged", "status": "completed", "tag": "e06513e6-121c-46e8-849f-16261f3ab3f8", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:09.447855 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-509180dd-f8b1-4fa9-9bca-67857897723d {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:09.449329 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5947bb8-5332-4306-992c-c2051380d339', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'e06513e6-121c-46e8-849f-16261f3ab3f8', 'code': 200} Nov 18 21:04:09.468241 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-1bdbdd9a-1a0f-484d-8d71-86d1b884986b None None] Provisioning complete for port e439a92d-6b32-4acc-93a3-91c54d8ca660 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:04:09.472254 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1bdbdd9a-1a0f-484d-8d71-86d1b884986b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:09.668669 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24eeb2e4-fc42-464d-b86d-39d4f17716c1 req-cb26b81a-525f-435b-93db-6fc071d7c6df tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:09.671042 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-24eeb2e4-fc42-464d-b86d-39d4f17716c1 req-cb26b81a-525f-435b-93db-6fc071d7c6df tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1666381 Nov 18 21:04:09.892971 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-24eeb2e4-fc42-464d-b86d-39d4f17716c1 req-3262ff3d-c212-4731-b2dd-8ed1714624a8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2005360 Nov 18 21:04:10.148139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b23c2f92-7047-437f-9d7a-adb3eb320a34 req-5045d3d7-df3e-4295-8a9e-3f7dd3e6ce3b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:10.160936 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b23c2f92-7047-437f-9d7a-adb3eb320a34 req-5045d3d7-df3e-4295-8a9e-3f7dd3e6ce3b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1535935 Nov 18 21:04:10.402117 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b23c2f92-7047-437f-9d7a-adb3eb320a34 req-6b5c2e14-d437-441e-94e6-2ca5d2e629ba tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2316060 Nov 18 21:04:10.561752 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09689bd6-7988-4565-a0c9-4b04c404d854 req-a086ca1c-9f29-4ab8-b7db-e11170070479 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:10.565193 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-09689bd6-7988-4565-a0c9-4b04c404d854 req-a086ca1c-9f29-4ab8-b7db-e11170070479 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0672991 Nov 18 21:04:10.668131 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-09689bd6-7988-4565-a0c9-4b04c404d854 req-ea548975-11c0-486b-af05-41fa5d29d704 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0905080 Nov 18 21:04:11.171251 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd6c45a3-38cb-4fd6-820d-1dde0be79ef1 req-ff334969-c708-4e22-a776-3e30d4070835 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:11.175817 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd6c45a3-38cb-4fd6-820d-1dde0be79ef1 req-ff334969-c708-4e22-a776-3e30d4070835 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1032257 Nov 18 21:04:11.309068 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd6c45a3-38cb-4fd6-820d-1dde0be79ef1 req-31ea944d-d482-4c16-930d-9f6f38f67be3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1242247 Nov 18 21:04:11.659346 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14c6d221-2ab9-4e3b-9d0f-c758b7829a13 req-d8e07785-c3df-4481-b358-e4fca030fcff tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:11.675223 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-14c6d221-2ab9-4e3b-9d0f-c758b7829a13 req-d8e07785-c3df-4481-b358-e4fca030fcff tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1170688 Nov 18 21:04:11.779576 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-14c6d221-2ab9-4e3b-9d0f-c758b7829a13 req-aa114cf3-85f1-41f7-a16e-0d7090e8a9a2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1032720 Nov 18 21:04:11.932046 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41d5cfa6-dc1c-4db8-ae23-5effa510a833 req-3998a47b-f0ea-4057-999d-d4c6cf3ef479 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:11.936746 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-41d5cfa6-dc1c-4db8-ae23-5effa510a833 req-3998a47b-f0ea-4057-999d-d4c6cf3ef479 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1386926 Nov 18 21:04:12.029128 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-41d5cfa6-dc1c-4db8-ae23-5effa510a833 req-2ba79e10-cc7f-49a7-8a42-bc50504c696e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890665 Nov 18 21:04:12.550071 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56e26c9a-6717-4640-a575-8bfe624c97e3 req-a0f8eb72-3241-4f58-a95e-113a6026bc0b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:12.561328 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-56e26c9a-6717-4640-a575-8bfe624c97e3 req-a0f8eb72-3241-4f58-a95e-113a6026bc0b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1070564 Nov 18 21:04:12.665006 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-56e26c9a-6717-4640-a575-8bfe624c97e3 req-50999281-b4ff-429d-b85f-318097b282a0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1017122 Nov 18 21:04:12.924921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f76b744-4521-4498-82ea-8e3ed6e51da0 req-e3c2ac16-d96d-4650-a6c3-1f1287236249 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:12.926842 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7f76b744-4521-4498-82ea-8e3ed6e51da0 req-e3c2ac16-d96d-4650-a6c3-1f1287236249 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0571573 Nov 18 21:04:13.004854 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7f76b744-4521-4498-82ea-8e3ed6e51da0 req-5e0ff106-3953-45bf-a819-f25a27fe57c6 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712686 Nov 18 21:04:13.239172 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd605de8-7ac2-4d54-8fab-257fe984aa46 req-a199e09b-6b67-47b2-a784-a6fd802be65c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:13.247566 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd605de8-7ac2-4d54-8fab-257fe984aa46 req-a199e09b-6b67-47b2-a784-a6fd802be65c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1143148 Nov 18 21:04:13.374980 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd605de8-7ac2-4d54-8fab-257fe984aa46 req-706a1b10-6e52-49de-8258-945e4e369861 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1259289 Nov 18 21:04:13.952890 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5d2841c-0fb9-4a36-a2fe-8608dafed2b8 req-41aa5c32-fce4-4dd3-b87e-9b79b8779237 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:13.957204 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d5d2841c-0fb9-4a36-a2fe-8608dafed2b8 req-41aa5c32-fce4-4dd3-b87e-9b79b8779237 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1051300 Nov 18 21:04:14.068046 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d5d2841c-0fb9-4a36-a2fe-8608dafed2b8 req-dc54883c-f3bd-47c2-af01-96e9f0bb6758 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1019812 Nov 18 21:04:14.289875 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b380c9ab-1998-4b16-8206-b5a05c5d7dde req-bbe2118c-3395-4927-b9ea-4c5adcb3fab2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:14.292703 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b380c9ab-1998-4b16-8206-b5a05c5d7dde req-bbe2118c-3395-4927-b9ea-4c5adcb3fab2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1248429 Nov 18 21:04:14.401935 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b380c9ab-1998-4b16-8206-b5a05c5d7dde req-445b8395-58bf-4f33-be4b-6ece02934b5b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931909 Nov 18 21:04:14.739682 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d47b8101-6e34-43ce-987b-cdeb55935bfe req-edd7fd17-4f4d-4daa-9d1f-fed82359cccf tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:14.756834 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d47b8101-6e34-43ce-987b-cdeb55935bfe req-edd7fd17-4f4d-4daa-9d1f-fed82359cccf tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2345769 Nov 18 21:04:14.889643 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d47b8101-6e34-43ce-987b-cdeb55935bfe req-c9d42b8e-3df6-437c-96a3-85506ad55934 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1226459 Nov 18 21:04:15.333436 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1d7d5e6-ee71-4f88-831b-4fa4c4471d3b req-71efcaa1-778c-4b54-a777-25e0fef2eea4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:15.343158 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c1d7d5e6-ee71-4f88-831b-4fa4c4471d3b req-71efcaa1-778c-4b54-a777-25e0fef2eea4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0901916 Nov 18 21:04:15.464978 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c1d7d5e6-ee71-4f88-831b-4fa4c4471d3b req-77fb8c8e-3ac3-497a-b604-dc16ef8fbc7a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1204710 Nov 18 21:04:15.599037 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98cb6f20-6e95-495d-a5a5-b06146f5c124 req-47a6191c-883c-41ba-9bf1-8daa1f90400e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:15.608915 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-98cb6f20-6e95-495d-a5a5-b06146f5c124 req-47a6191c-883c-41ba-9bf1-8daa1f90400e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0978973 Nov 18 21:04:15.754504 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-98cb6f20-6e95-495d-a5a5-b06146f5c124 req-64491bbb-6012-483b-b72f-ac9cb278a5f6 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1438336 Nov 18 21:04:16.122539 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5622b3fe-95ce-4a33-9748-eeadb5d07f9c req-1837798d-2f40-4a3c-9b60-545368d2a86b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:16.135991 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5622b3fe-95ce-4a33-9748-eeadb5d07f9c req-1837798d-2f40-4a3c-9b60-545368d2a86b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1084223 Nov 18 21:04:16.247442 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5622b3fe-95ce-4a33-9748-eeadb5d07f9c req-bfaf3d29-ca3e-47db-8ae4-d2c795778abe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1098397 Nov 18 21:04:16.732469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddc03db-2a49-46df-bbb8-4d2ed3812e16 req-ad289f8c-3645-45fa-a96b-fe4bb8541c9c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:16.745879 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cddc03db-2a49-46df-bbb8-4d2ed3812e16 req-ad289f8c-3645-45fa-a96b-fe4bb8541c9c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0940039 Nov 18 21:04:16.861941 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cddc03db-2a49-46df-bbb8-4d2ed3812e16 req-09674f10-cde5-4dfb-9e77-df5b60759e08 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0959966 Nov 18 21:04:16.998171 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc0139c9-ba83-405b-b0eb-101a595f7f9f req-430adc15-bb8c-4465-98cd-4153bbdf4473 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:17.000410 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bc0139c9-ba83-405b-b0eb-101a595f7f9f req-430adc15-bb8c-4465-98cd-4153bbdf4473 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0909216 Nov 18 21:04:17.165049 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bc0139c9-ba83-405b-b0eb-101a595f7f9f req-d8b67c8c-a41c-4f74-acf2-9d8ff2bdce56 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1429420 Nov 18 21:04:17.501871 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57111bf6-28a0-4bab-ad2d-7e8cbc467f4e req-6af53a9b-f5e3-433e-9e60-a937d50926e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:17.503610 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-57111bf6-28a0-4bab-ad2d-7e8cbc467f4e req-6af53a9b-f5e3-433e-9e60-a937d50926e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0831666 Nov 18 21:04:17.613045 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-57111bf6-28a0-4bab-ad2d-7e8cbc467f4e req-92aaa69c-e624-4878-a99e-53f1f761f08d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0946484 Nov 18 21:04:18.077987 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f790e790-3465-4466-b9ba-dfefade74157 req-f4e5016d-dd76-42e1-8a61-8df24ef04216 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:18.085715 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f790e790-3465-4466-b9ba-dfefade74157 req-f4e5016d-dd76-42e1-8a61-8df24ef04216 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0844316 Nov 18 21:04:18.197276 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f790e790-3465-4466-b9ba-dfefade74157 req-69e1c280-17b9-4e42-8163-0a47dbccf9cf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1093118 Nov 18 21:04:18.398908 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-837d0709-78c8-4939-9d2e-4ea04cb25ffb req-11fd7bb8-385d-4c0d-89bd-f6ca391953ef tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:18.401334 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-837d0709-78c8-4939-9d2e-4ea04cb25ffb req-11fd7bb8-385d-4c0d-89bd-f6ca391953ef tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0860064 Nov 18 21:04:18.480646 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-837d0709-78c8-4939-9d2e-4ea04cb25ffb req-b562dd16-a612-41f1-8c1e-f07c2f820720 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727265 Nov 18 21:04:18.894412 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be3ec346-6c11-4ea2-b51e-84f5aee8a085 req-69eb808e-5cd0-465d-9172-d3c2ce41ce24 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:18.908217 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-be3ec346-6c11-4ea2-b51e-84f5aee8a085 req-69eb808e-5cd0-465d-9172-d3c2ce41ce24 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1416953 Nov 18 21:04:19.059610 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-be3ec346-6c11-4ea2-b51e-84f5aee8a085 req-3efa02d9-a9c4-49dd-ab48-a2ed5d9d787d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1548862 Nov 18 21:04:19.346000 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:19.450775 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f11859e-55da-4c21-a77c-6711ed2090e6 req-a405a5e1-cfcb-4692-b0d1-0a50d357420e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:19.453358 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6f11859e-55da-4c21-a77c-6711ed2090e6 req-a405a5e1-cfcb-4692-b0d1-0a50d357420e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0621815 Nov 18 21:04:19.521258 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6f11859e-55da-4c21-a77c-6711ed2090e6 req-49ffe9bf-9939-4d3c-98dc-b76718d7dcd9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490119 Nov 18 21:04:19.804246 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-302e9a7c-44f4-4ada-b378-6faf14cb41ff req-53524da3-3f00-4e26-b4da-44ed927ace58 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:19.809547 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-302e9a7c-44f4-4ada-b378-6faf14cb41ff req-53524da3-3f00-4e26-b4da-44ed927ace58 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1624932 Nov 18 21:04:19.924899 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-302e9a7c-44f4-4ada-b378-6faf14cb41ff req-e715bcb1-8cb0-46a5-9fde-43e8b27e67b9 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993218 Nov 18 21:04:20.319608 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fca74db-c5e9-4db6-885a-5d4914be838b req-939f94ca-92c8-40b4-b3be-3bddb46e1a03 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:20.321243 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2fca74db-c5e9-4db6-885a-5d4914be838b req-939f94ca-92c8-40b4-b3be-3bddb46e1a03 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0871098 Nov 18 21:04:20.401647 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2fca74db-c5e9-4db6-885a-5d4914be838b req-0fffb360-a80a-4c60-817d-941a04a16c71 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703888 Nov 18 21:04:20.930972 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e74d8f7e-73d6-403e-ae69-8ecb54b92ba5 req-b8fa61d2-063b-49b6-975d-3a42565d36ef tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:20.943751 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e74d8f7e-73d6-403e-ae69-8ecb54b92ba5 req-b8fa61d2-063b-49b6-975d-3a42565d36ef tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.2455814 Nov 18 21:04:21.103524 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e74d8f7e-73d6-403e-ae69-8ecb54b92ba5 req-c8dea9f7-5bfe-492f-b985-9524d1bb504f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1524808 Nov 18 21:04:21.169426 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 37898) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:21.184420 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-21310a7d-db88-4752-8c46-abb251fd217f req-d796aa99-fcb4-4d22-8e4d-35218c70cd03 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:21.186279 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-21310a7d-db88-4752-8c46-abb251fd217f req-d796aa99-fcb4-4d22-8e4d-35218c70cd03 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0985420 Nov 18 21:04:21.275835 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-21310a7d-db88-4752-8c46-abb251fd217f req-3f4d654c-2ad9-46ab-8deb-7e8eff3a1a1e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0691259 Nov 18 21:04:21.389652 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-83fe0d8f-0767-47f1-999b-5b94961d0134 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.553132 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-83fe0d8f-0767-47f1-999b-5b94961d0134 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.559601 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-83fe0d8f-0767-47f1-999b-5b94961d0134 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.729533 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-83fe0d8f-0767-47f1-999b-5b94961d0134 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6b95f2b882a542239023c844a815041f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5586448 Nov 18 21:04:21.737015 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 37906) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:21.744260 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fe0d8f-0767-47f1-999b-5b94961d0134 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfecd2a1-a81d-401a-a9b9-e4ebae193528,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:21.833866 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-176a367a-b99a-471c-92f9-9f40e7b91efb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.859532 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-01e418de-79a0-42d0-aa8e-eb8b4943dbb9 req-2ceba606-4da3-4970-8584-01799c30e5f8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:21.873219 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-176a367a-b99a-471c-92f9-9f40e7b91efb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.874130 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-01e418de-79a0-42d0-aa8e-eb8b4943dbb9 req-2ceba606-4da3-4970-8584-01799c30e5f8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.2292335 Nov 18 21:04:21.975292 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-01e418de-79a0-42d0-aa8e-eb8b4943dbb9 req-f92fa7c3-5fe4-42a8-b3eb-bf202b9263d6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0996082 Nov 18 21:04:21.987516 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-176a367a-b99a-471c-92f9-9f40e7b91efb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.992478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-176a367a-b99a-471c-92f9-9f40e7b91efb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:21.994072 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-176a367a-b99a-471c-92f9-9f40e7b91efb admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/dfecd2a1-a81d-401a-a9b9-e4ebae193528 HTTP/1.1" status: 204 len: 168 time: 0.2555196 Nov 18 21:04:22.024627 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-176a367a-b99a-471c-92f9-9f40e7b91efb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfecd2a1-a81d-401a-a9b9-e4ebae193528,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:22.515166 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0e930ee-f897-4802-959e-a80c621f8333 req-7f4e65a8-6016-463b-a7e1-187ca028f67a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:22.517950 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f0e930ee-f897-4802-959e-a80c621f8333 req-7f4e65a8-6016-463b-a7e1-187ca028f67a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1043270 Nov 18 21:04:22.623899 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52bf5b1b-7ad2-47ba-b925-aa006db61aa1 req-70067526-ab4d-44de-80b9-8acba805dad4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:22.625553 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-52bf5b1b-7ad2-47ba-b925-aa006db61aa1 req-70067526-ab4d-44de-80b9-8acba805dad4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1203430 Nov 18 21:04:22.640580 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f0e930ee-f897-4802-959e-a80c621f8333 req-dedfe854-74fd-41c2-85a0-fb633249ee0e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1158569 Nov 18 21:04:22.758141 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-52bf5b1b-7ad2-47ba-b925-aa006db61aa1 req-0f1a970d-9ac1-4b01-87d1-a2e21adb2be5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1126950 Nov 18 21:04:23.424159 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ca1e56e7-9260-4825-b0eb-1b15ee72335f req-5f1761de-cdb2-4744-8e69-212b3e7c12f3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:23.426682 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ca1e56e7-9260-4825-b0eb-1b15ee72335f req-5f1761de-cdb2-4744-8e69-212b3e7c12f3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1670384 Nov 18 21:04:23.525014 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ca1e56e7-9260-4825-b0eb-1b15ee72335f req-101e3261-6b00-4dcd-82e7-c11efa7c1180 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0858252 Nov 18 21:04:23.928529 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c76407f9-f30e-4205-b60d-cbf08761f525 req-d90e5b0e-c4c5-4254-8b6d-67aa6332cbcb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:23.938094 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c76407f9-f30e-4205-b60d-cbf08761f525 req-d90e5b0e-c4c5-4254-8b6d-67aa6332cbcb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1631479 Nov 18 21:04:23.971997 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-70bc0f2b-ca72-4d84-83eb-3a249070a0bc req-2b0a7590-0a2a-4d93-bb5a-36b67ade3173 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:23.981433 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-70bc0f2b-ca72-4d84-83eb-3a249070a0bc req-2b0a7590-0a2a-4d93-bb5a-36b67ade3173 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1154914 Nov 18 21:04:24.062946 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c76407f9-f30e-4205-b60d-cbf08761f525 req-723ecf1c-5952-47de-acac-d68eb982e8f5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1144869 Nov 18 21:04:24.100840 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-70bc0f2b-ca72-4d84-83eb-3a249070a0bc req-54439669-27ff-4366-87c8-d73b3e417be7 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1137977 Nov 18 21:04:24.888830 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eafafdac-a1d3-499e-bc2b-dc7a7b3225ab req-d9a6164a-8ba2-4c53-af77-8b42e427bc8a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:24.892906 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eafafdac-a1d3-499e-bc2b-dc7a7b3225ab req-d9a6164a-8ba2-4c53-af77-8b42e427bc8a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1303978 Nov 18 21:04:25.039471 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eafafdac-a1d3-499e-bc2b-dc7a7b3225ab req-e2bde440-8847-45f5-9624-b1032a6b6988 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1385968 Nov 18 21:04:25.229840 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2df2591-aa28-43bb-9b58-35cc55b8f8ad req-29167bfa-9b3b-47ee-a0a5-89bd9edb34e6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:25.241636 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e2df2591-aa28-43bb-9b58-35cc55b8f8ad req-29167bfa-9b3b-47ee-a0a5-89bd9edb34e6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0873737 Nov 18 21:04:25.275835 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5628bd0-f122-49d9-9157-dc45d1a86dd0 req-1c7c4acf-4b82-485e-b970-cd35980008ed tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:25.287037 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f5628bd0-f122-49d9-9157-dc45d1a86dd0 req-1c7c4acf-4b82-485e-b970-cd35980008ed tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0893028 Nov 18 21:04:25.399853 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f5628bd0-f122-49d9-9157-dc45d1a86dd0 req-a8f94146-3bfc-4ed8-b4d7-9ec5c3fb6f19 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1111438 Nov 18 21:04:25.405782 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e2df2591-aa28-43bb-9b58-35cc55b8f8ad req-4b1f6744-8062-4a4d-bce3-5f4dc0af1acc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1629121 Nov 18 21:04:26.496100 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-947b7979-364f-4f42-b24f-ccf847aea624 req-a228315a-6851-458f-a6d3-de149c814703 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:26.506781 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-947b7979-364f-4f42-b24f-ccf847aea624 req-a228315a-6851-458f-a6d3-de149c814703 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.3021247 Nov 18 21:04:26.674502 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-947b7979-364f-4f42-b24f-ccf847aea624 req-806d8b81-753f-41b6-a30a-b5da262daddd tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1664166 Nov 18 21:04:26.890562 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32d91885-f554-42c0-8da6-43bff88e8b02 req-af40b0f7-403d-4b5e-9950-7d1529a8f024 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:26.902696 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-32d91885-f554-42c0-8da6-43bff88e8b02 req-af40b0f7-403d-4b5e-9950-7d1529a8f024 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1063414 Nov 18 21:04:26.937021 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4b6ca5c-64a8-4b2a-909c-130dd6ad81c2 req-9f51ef12-7291-43da-9171-24091b8ca006 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:26.948825 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e4b6ca5c-64a8-4b2a-909c-130dd6ad81c2 req-9f51ef12-7291-43da-9171-24091b8ca006 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1536734 Nov 18 21:04:27.056743 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-32d91885-f554-42c0-8da6-43bff88e8b02 req-fb8ebe95-7d38-469c-92b2-9a9e4f5311ef tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1460989 Nov 18 21:04:27.079370 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e4b6ca5c-64a8-4b2a-909c-130dd6ad81c2 req-1a706f1d-5424-48ed-b27a-50c796c69eb0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1281817 Nov 18 21:04:27.955784 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26fef92c-763e-444e-baec-6a9792658b88 req-1d85b112-ee71-4cfe-8321-791ac07d8a89 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:27.973061 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-26fef92c-763e-444e-baec-6a9792658b88 req-1d85b112-ee71-4cfe-8321-791ac07d8a89 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1535482 Nov 18 21:04:28.215382 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-26fef92c-763e-444e-baec-6a9792658b88 req-9ab3f938-04cf-4836-963d-21cfe0d583d8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2394373 Nov 18 21:04:28.349648 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77ee2be4-afec-4a6e-9d18-a2d427228713 req-b8d139f8-c0cd-4c1d-8b44-a8e65f1e2172 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:28.357745 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-77ee2be4-afec-4a6e-9d18-a2d427228713 req-b8d139f8-c0cd-4c1d-8b44-a8e65f1e2172 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0829067 Nov 18 21:04:28.458108 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91dbca86-913e-41e1-a79c-f0d36815cca1 req-1934b764-25e5-4fd2-bc62-324e07fc3ba9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:28.473432 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-91dbca86-913e-41e1-a79c-f0d36815cca1 req-1934b764-25e5-4fd2-bc62-324e07fc3ba9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1109860 Nov 18 21:04:28.522563 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-77ee2be4-afec-4a6e-9d18-a2d427228713 req-bdec1008-0de3-482a-a7c9-2f72b1eaa78e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1635187 Nov 18 21:04:28.575609 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-91dbca86-913e-41e1-a79c-f0d36815cca1 req-48e5c37c-864b-4de8-9755-75d8a790afb8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0987313 Nov 18 21:04:29.414156 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e32dff3-d974-4fb3-b3fd-ddcbe69d3b3e req-af6fa0dd-cdfa-4503-80a8-f4da1a1d5b81 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:29.415947 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9e32dff3-d974-4fb3-b3fd-ddcbe69d3b3e req-af6fa0dd-cdfa-4503-80a8-f4da1a1d5b81 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0831685 Nov 18 21:04:29.499450 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9e32dff3-d974-4fb3-b3fd-ddcbe69d3b3e req-bb1d45be-51fa-4eab-bf92-208248e31720 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0727167 Nov 18 21:04:29.704086 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f07697db-ea85-42e5-bb06-69238edd0973 req-7433601d-5615-4704-93e4-683bf78a0db9 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:29.706314 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f07697db-ea85-42e5-bb06-69238edd0973 req-7433601d-5615-4704-93e4-683bf78a0db9 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0762477 Nov 18 21:04:29.741573 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80d7940d-6d8f-48f5-840c-2892463017c4 req-a23f93ce-2e17-4743-8e63-dbef88354c73 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:29.743921 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80d7940d-6d8f-48f5-840c-2892463017c4 req-a23f93ce-2e17-4743-8e63-dbef88354c73 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0703807 Nov 18 21:04:29.792091 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f07697db-ea85-42e5-bb06-69238edd0973 req-fe8a8f08-5c6f-4b62-9161-dc541fb893d5 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0774388 Nov 18 21:04:29.832358 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80d7940d-6d8f-48f5-840c-2892463017c4 req-ee90397f-25ad-4c37-9150-e7ab0547ca95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0800214 Nov 18 21:04:30.654957 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-194ae871-8add-4038-8518-53596d8b3922 req-22433178-5871-4d07-a5fd-fed988abbe98 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:30.656533 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-194ae871-8add-4038-8518-53596d8b3922 req-22433178-5871-4d07-a5fd-fed988abbe98 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0570166 Nov 18 21:04:30.727459 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-194ae871-8add-4038-8518-53596d8b3922 req-4802b508-0425-4658-9dce-1f83edd59bbe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0636063 Nov 18 21:04:30.979070 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-590ad893-0ab2-4252-8f91-7383f6ac8ac0 req-cd1c18f8-7f00-485b-b376-9ab9fceac0a3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:30.981611 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-590ad893-0ab2-4252-8f91-7383f6ac8ac0 req-cd1c18f8-7f00-485b-b376-9ab9fceac0a3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0881741 Nov 18 21:04:31.006192 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7782c2e7-d41e-4268-abc6-85a0cf59f549 req-e6206626-d711-47f1-91b4-8e94306b26aa tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:31.007914 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7782c2e7-d41e-4268-abc6-85a0cf59f549 req-e6206626-d711-47f1-91b4-8e94306b26aa tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0628643 Nov 18 21:04:31.049010 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-590ad893-0ab2-4252-8f91-7383f6ac8ac0 req-1ae94be2-a62e-4014-a3ec-23bc7b64e6e8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0580833 Nov 18 21:04:31.081328 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7782c2e7-d41e-4268-abc6-85a0cf59f549 req-f33a7604-cdb8-43bd-99ca-dd1d4ef3fe66 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0634959 Nov 18 21:04:31.931871 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-630fd377-ca0b-46e2-9c5a-d2f059294bd3 req-68a18268-5c4f-40b9-946a-f70910e99c39 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:31.933509 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-630fd377-ca0b-46e2-9c5a-d2f059294bd3 req-68a18268-5c4f-40b9-946a-f70910e99c39 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0816796 Nov 18 21:04:31.993949 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-630fd377-ca0b-46e2-9c5a-d2f059294bd3 req-e0a61b60-4c72-40a2-b0b9-98d2cf7621e2 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526261 Nov 18 21:04:32.204797 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6363d1e0-4a4a-48d0-a779-53f2fcef650c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:32.216027 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-abbac210-3a60-4633-bcb4-72be291e4c79 req-e6c1dea4-80fa-4fd5-9a07-b1222fb62f15 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:32.217724 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-abbac210-3a60-4633-bcb4-72be291e4c79 req-e6c1dea4-80fa-4fd5-9a07-b1222fb62f15 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0687900 Nov 18 21:04:32.292238 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-abbac210-3a60-4633-bcb4-72be291e4c79 req-10091a39-dc5c-497c-ab4d-c8937d59415f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0614095 Nov 18 21:04:32.295004 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5db21ebe-4c27-45fa-a52a-511e69bfdba0 req-85f9857f-ecd2-4240-9f79-562602382e43 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:32.297356 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5db21ebe-4c27-45fa-a52a-511e69bfdba0 req-85f9857f-ecd2-4240-9f79-562602382e43 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1026943 Nov 18 21:04:32.369554 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5db21ebe-4c27-45fa-a52a-511e69bfdba0 req-d204d1c5-f1e9-4f4a-99b9-ff24971b74f7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616045 Nov 18 21:04:32.880156 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 38112) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:32.949292 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Deleting subnet e48c8bc2-bbdc-434c-9eda-2ef0cb808732 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:04:32.954675 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.025481 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.205097 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.217190 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-2870a25f-33df-4bab-91be-cdde2e00f8a3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:33.233213 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-2870a25f-33df-4bab-91be-cdde2e00f8a3 service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.2933962 Nov 18 21:04:33.274317 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0700ea3-4023-4f11-97e1-1118be958fcb req-34e66b7c-f808-44dc-93b6-8813ebafc689 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:33.276722 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f0700ea3-4023-4f11-97e1-1118be958fcb req-34e66b7c-f808-44dc-93b6-8813ebafc689 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1492543 Nov 18 21:04:33.373015 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5992038f-0d38-4a57-b03b-aab96afb537c req-0d910548-571a-4da3-9193-d133ce009fb9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:33.374638 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5992038f-0d38-4a57-b03b-aab96afb537c req-0d910548-571a-4da3-9193-d133ce009fb9 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 1099 time: 0.0738914 Nov 18 21:04:33.378233 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-838f9107-d523-4b46-9e18-09ad7e453cb7 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 1000 time: 0.1298754 Nov 18 21:04:33.383662 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f0700ea3-4023-4f11-97e1-1118be958fcb req-cc0eaf3a-1f7f-4e0f-90a1-19152ef56e9b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0931759 Nov 18 21:04:33.397532 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.451889 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.456465 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/e48c8bc2-bbdc-434c-9eda-2ef0cb808732 HTTP/1.1" status: 204 len: 168 time: 0.5739167 Nov 18 21:04:33.458404 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-014661ef-c5fd-406a-9fe0-fa52b4ac4846 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=e48c8bc2-bbdc-434c-9eda-2ef0cb808732,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:33.461020 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 38124) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:33.597494 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5992038f-0d38-4a57-b03b-aab96afb537c req-171bd06f-872d-476e-a425-d00783a26422 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1932371 Nov 18 21:04:33.599858 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-4c498c00-3836-4901-b39a-29b5c1a5cb29 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:33.601389 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e01181b-1f2f-40a0-998e-326529b9171b req-773059fb-2bab-4238-93da-796ae228cbd3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:33.602359 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-4c498c00-3836-4901-b39a-29b5c1a5cb29 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.1510036 Nov 18 21:04:33.602932 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e01181b-1f2f-40a0-998e-326529b9171b req-773059fb-2bab-4238-93da-796ae228cbd3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0743771 Nov 18 21:04:33.605472 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.637661 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60710c00-f4cf-401a-a639-0db4aaad26b8 req-659eb6f5-90eb-4bb3-b143-42e7658a9aee tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:33.645555 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-60710c00-f4cf-401a-a639-0db4aaad26b8 req-659eb6f5-90eb-4bb3-b143-42e7658a9aee tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.2178450 Nov 18 21:04:33.722715 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e01181b-1f2f-40a0-998e-326529b9171b req-f7641c21-b531-4a08-a7a6-ef37e6510051 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1081123 Nov 18 21:04:33.725822 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-60710c00-f4cf-401a-a639-0db4aaad26b8 req-e879db7b-8002-4cf6-95d3-ac3be7cd3b04 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712543 Nov 18 21:04:33.734406 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.765265 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:04:33.772148 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['114fdaf6-871a-4adc-a451-0c84b8e723ab']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:33.789226 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'a71d8294-97d3-4004-81eb-f3aa0b67272e') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:33.789654 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'a71d8294-97d3-4004-81eb-f3aa0b67272e') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:04:33.807165 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.829673 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.838701 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Releasing vlan 643 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:04:33.839181 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:04:33.841250 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:04:33.908470 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.914985 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:33.921106 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] 10.222.0.61 "DELETE /v2.0/networks/114fdaf6-871a-4adc-a451-0c84b8e723ab HTTP/1.1" status: 204 len: 168 time: 0.4581196 Nov 18 21:04:33.939491 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fff5a74c-e581-4c60-b747-112449f9f434 admin admin] Pushing event deleted for resources: {'Network': ['ID=114fdaf6-871a-4adc-a451-0c84b8e723ab,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:34.142094 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 38128) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:34.189368 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-30b2f790-8433-4d4b-9124-7e76775e86ac admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=851311932c184209baa31bf73923469b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0459719 Nov 18 21:04:34.191752 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 38130) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:34.260999 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7c49f45d-bc8d-4bc8-a767-6ced0a718a17 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:34.291780 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7c49f45d-bc8d-4bc8-a767-6ced0a718a17 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:34.361340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7c49f45d-bc8d-4bc8-a767-6ced0a718a17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:34.365921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7c49f45d-bc8d-4bc8-a767-6ced0a718a17 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:34.376488 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7c49f45d-bc8d-4bc8-a767-6ced0a718a17 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d7355816-4070-4155-99bc-14b88fcea03e HTTP/1.1" status: 204 len: 168 time: 0.1747458 Nov 18 21:04:34.383133 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c49f45d-bc8d-4bc8-a767-6ced0a718a17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d7355816-4070-4155-99bc-14b88fcea03e,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:34.579943 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53c68d32-36d2-4d53-926c-9728673d0c68 req-fa3fd759-7f12-42e1-b4b7-3b62d0d770d5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:34.588535 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-53c68d32-36d2-4d53-926c-9728673d0c68 req-fa3fd759-7f12-42e1-b4b7-3b62d0d770d5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0920198 Nov 18 21:04:34.631121 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6b129eb2-61c3-4651-9272-b4d97ddcedce None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:34.664674 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-53c68d32-36d2-4d53-926c-9728673d0c68 req-010c988d-01c4-4afa-bfb5-9073734eec39 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0750020 Nov 18 21:04:34.916473 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6fdee762-df4f-4fb3-9772-6672e4e567b7 req-0f743cac-9c82-47dc-853e-b4a5f0bfaa58 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:34.918451 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5511d88-9077-48fd-98fb-64d2fea23340 req-0c3b3a8b-0caf-44fb-8e7b-e3d9551b3c1f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:34.919199 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6fdee762-df4f-4fb3-9772-6672e4e567b7 req-0f743cac-9c82-47dc-853e-b4a5f0bfaa58 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0694366 Nov 18 21:04:34.928794 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f5511d88-9077-48fd-98fb-64d2fea23340 req-0c3b3a8b-0caf-44fb-8e7b-e3d9551b3c1f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0939560 Nov 18 21:04:34.983877 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6fdee762-df4f-4fb3-9772-6672e4e567b7 req-1da2f264-1386-4d6a-b13e-25b4a69a5dd8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0542369 Nov 18 21:04:35.013577 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f5511d88-9077-48fd-98fb-64d2fea23340 req-985459b9-dc13-4ef4-a3c8-ce6c7d9ee628 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806143 Nov 18 21:04:35.300404 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 38160) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:35.440934 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-149473720-network', 'tenant_id': '54afe6a32ce84eeca2df58c524125ab7'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:35.468931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Made reservation on behalf of 54afe6a32ce84eeca2df58c524125ab7 for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:04:35.472274 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.482149 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.586764 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.591291 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.635107 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 627} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:04:35.646139 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=040b98b0-a1d4-4e5e-81aa-ef1bba094812,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:35.652926 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.653296 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Added segment 598e0f87-4a96-43e2-99cc-de98be15abf0 of type vlan for network 9cb58b73-7745-413b-a6b6-30673daa4d11 Nov 18 21:04:35.717942 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.746722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.747957 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:35.748982 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.812058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ac74903-11ea-4682-a45f-1e32583ff2a5 req-cc471314-9149-47d9-81f2-de6089ffba9a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:35.814439 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6ac74903-11ea-4682-a45f-1e32583ff2a5 req-cc471314-9149-47d9-81f2-de6089ffba9a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0725458 Nov 18 21:04:35.818052 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 886 time: 0.5161879 Nov 18 21:04:35.821237 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 38168) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:04:35.829506 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Request body: {'subnet': {'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-149473720-subnet', 'tenant_id': '54afe6a32ce84eeca2df58c524125ab7', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:35.831236 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-09e581f7-60f7-46a1-b027-e85888f16f39 admin admin] Pushing event updated for resources: {'Network': ['ID=9cb58b73-7745-413b-a6b6-30673daa4d11,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:35.843901 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 9cb58b73-7745-413b-a6b6-30673daa4d11 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:04:35.876255 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Made reservation on behalf of 54afe6a32ce84eeca2df58c524125ab7 for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:04:35.878631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:35.930997 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6ac74903-11ea-4682-a45f-1e32583ff2a5 req-914ddf6b-8d14-47cf-be46-8cb5568cdd65 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1059694 Nov 18 21:04:35.990730 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:36.118849 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:36.143616 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7a582f0-e240-4119-8768-3ff062ed176a req-5110dd4d-3097-45a4-9a80-09d3caa8129c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:36.145525 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f7a582f0-e240-4119-8768-3ff062ed176a req-5110dd4d-3097-45a4-9a80-09d3caa8129c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0632675 Nov 18 21:04:36.210996 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Pushing event updated for resources: {'Subnet': ['ID=71e073e2-1e60-4ca4-a663-24a014f3734d,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:36.221489 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b5fcdc6-c793-4a77-9647-f4ac09870421 req-8ea76b6a-4b94-4fa8-9a05-fd1ce3385f13 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:36.223158 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8b5fcdc6-c793-4a77-9647-f4ac09870421 req-8ea76b6a-4b94-4fa8-9a05-fd1ce3385f13 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1252899 Nov 18 21:04:36.224981 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f7a582f0-e240-4119-8768-3ff062ed176a req-6e55ee4d-91bb-45b7-990a-907f66c78ac3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0641580 Nov 18 21:04:36.234580 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Checking segment: {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:04:36.236508 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Network hostable DHCP agents. Network: 9cb58b73-7745-413b-a6b6-30673daa4d11, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:04:36.289236 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Network 9cb58b73-7745-413b-a6b6-30673daa4d11 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:04:36.315223 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 9cb58b73-7745-413b-a6b6-30673daa4d11) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:04:36.322146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:36.322739 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:36.326428 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2008ed0a-4640-4db7-9452-2c45775fd42e None None] Network 9cb58b73-7745-413b-a6b6-30673daa4d11 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:04:36.329963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8b5fcdc6-c793-4a77-9647-f4ac09870421 req-74899cf5-a84e-4a82-a027-6d9db9fc4641 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886137 Nov 18 21:04:36.353521 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-bc3aa79f-970c-47c4-ab28-3f2c6a339510 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.5220234 Nov 18 21:04:36.518131 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ece665a1-c59b-4478-9b42-229be78bd5f9 None None] Network 9cb58b73-7745-413b-a6b6-30673daa4d11 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:04:36.954542 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-0c2ba297-f03d-4b1c-831b-5840f0587c8e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:36.956862 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-0c2ba297-f03d-4b1c-831b-5840f0587c8e service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0829947 Nov 18 21:04:37.096597 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-1ac35947-4bd4-4188-b188-ee11ae6461a2 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1212864 Nov 18 21:04:37.114288 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3583e3ca-c638-4ecd-9f12-42042f839319 req-62dff1f7-edd2-4429-b657-b4cc1cb6affe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:37.115992 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3583e3ca-c638-4ecd-9f12-42042f839319 req-62dff1f7-edd2-4429-b657-b4cc1cb6affe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0696921 Nov 18 21:04:37.194018 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3583e3ca-c638-4ecd-9f12-42042f839319 req-7570b93d-a4c9-4b3b-9b89-f03ee2d685eb tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0667467 Nov 18 21:04:37.228204 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f0cc56b-b317-4ba6-bf2f-c2d350b44745 req-627e4ec4-354e-405c-8075-22a2cf722a22 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1158721 Nov 18 21:04:37.417340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c7c60ed-9832-4028-84e2-57e579fa08a2 req-02b65b90-fdb5-48be-b92e-eba3d0273065 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:37.420546 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6c7c60ed-9832-4028-84e2-57e579fa08a2 req-02b65b90-fdb5-48be-b92e-eba3d0273065 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0786662 Nov 18 21:04:37.463898 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:37.518996 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6c7c60ed-9832-4028-84e2-57e579fa08a2 req-4874aa82-ed85-4410-b958-dd4e1ff3db91 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0907311 Nov 18 21:04:37.549135 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30954b89-c519-4fb0-8dcb-f91a0bc016bd req-aad5acce-d7cc-4809-897c-20abeb0f6e8e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:37.551949 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-30954b89-c519-4fb0-8dcb-f91a0bc016bd req-aad5acce-d7cc-4809-897c-20abeb0f6e8e tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0955865 Nov 18 21:04:37.621345 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-30954b89-c519-4fb0-8dcb-f91a0bc016bd req-ae925ac2-361a-4889-87c0-01c49b979f92 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0631106 Nov 18 21:04:38.259402 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:38.354750 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-204c398d-5d2d-42a1-ad25-f018022d526f tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:38.356958 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-204c398d-5d2d-42a1-ad25-f018022d526f tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/networks?id=9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 200 len: 813 time: 0.1944420 Nov 18 21:04:38.376348 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a7ed571-1fca-4ecd-b8af-a65c932b7de9 req-a4b74686-9e88-4a77-851d-64bf02a0d652 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:38.378180 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6a7ed571-1fca-4ecd-b8af-a65c932b7de9 req-a4b74686-9e88-4a77-851d-64bf02a0d652 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0657315 Nov 18 21:04:38.387317 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-15578a13-9d7b-4f8b-b601-854dd962a565 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/quotas/54afe6a32ce84eeca2df58c524125ab7 HTTP/1.1" status: 200 len: 375 time: 0.0162516 Nov 18 21:04:38.444652 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-e544e4b1-5b46-4054-a3b9-6b80dc7e1a81 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=54afe6a32ce84eeca2df58c524125ab7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0419362 Nov 18 21:04:38.459274 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6a7ed571-1fca-4ecd-b8af-a65c932b7de9 req-46919c29-9c8f-4453-9971-f9f4bee44177 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0680866 Nov 18 21:04:38.615637 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-adff514d-2f12-4190-ad26-5bf478304a9a service neutron] 10.222.0.61 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1577032 Nov 18 21:04:38.680366 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c62272a5-5bab-4f19-8031-b11155000e14 req-910008f3-0906-4bb4-b231-fd902ed14c2b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:38.685121 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c62272a5-5bab-4f19-8031-b11155000e14 req-910008f3-0906-4bb4-b231-fd902ed14c2b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0821807 Nov 18 21:04:38.761793 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c62272a5-5bab-4f19-8031-b11155000e14 req-f31d76d3-670f-4e13-a0d2-c72a0e85ccf2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0652974 Nov 18 21:04:38.796889 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-be7804dc-3d46-4581-9fbc-fd002f77864c service neutron] 10.222.0.61 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1726730 Nov 18 21:04:38.933805 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7fadfbf5-4b3d-47e6-973d-aa772b332655 req-a794dde7-7db8-4635-9c4a-c252b1dce343 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:38.935614 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7fadfbf5-4b3d-47e6-973d-aa772b332655 req-a794dde7-7db8-4635-9c4a-c252b1dce343 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0808465 Nov 18 21:04:39.043867 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7fadfbf5-4b3d-47e6-973d-aa772b332655 req-56d0608b-9165-4809-a07f-5fd51855c426 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0992324 Nov 18 21:04:39.060849 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-915f74b6-d0c8-4dfe-bbed-23a7e85fcb88 req-ceaf8847-5b3e-47b5-abd4-33e0c6c8dfef tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 210 time: 0.0531902 Nov 18 21:04:39.963418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92a98cb7-dd8c-4f0d-960d-14469d83aabb req-d89097fb-0be0-4a0d-a341-f1d8c5c2d84d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:39.965075 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-92a98cb7-dd8c-4f0d-960d-14469d83aabb req-d89097fb-0be0-4a0d-a341-f1d8c5c2d84d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.3977454 Nov 18 21:04:39.975859 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28d93a1e-19ef-4793-aff0-2a8265161c60 req-5dc87cd3-0b1a-436d-84c8-96100ce60bd9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:39.977007 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-28d93a1e-19ef-4793-aff0-2a8265161c60 req-5dc87cd3-0b1a-436d-84c8-96100ce60bd9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0788288 Nov 18 21:04:40.049822 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-28d93a1e-19ef-4793-aff0-2a8265161c60 req-74e3a8f5-b0a5-4f8c-8035-95af633a5d67 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0613251 Nov 18 21:04:40.053187 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-92a98cb7-dd8c-4f0d-960d-14469d83aabb req-656dd8d7-5931-4be0-8740-f5678459c628 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0764840 Nov 18 21:04:40.189440 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c7832b3-1823-478b-8719-0075171be507 req-bce79abb-5d3e-4d6a-8eb8-090babe4257b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 210 time: 0.0419526 Nov 18 21:04:40.692904 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-08244809-3200-4153-98fa-5bd65800ef11 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:40.695724 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-08244809-3200-4153-98fa-5bd65800ef11 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "GET /v2.0/networks?id=9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 200 len: 813 time: 0.1937354 Nov 18 21:04:40.721520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Request body: {'port': {'device_id': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11', 'admin_state_up': True, 'tenant_id': '54afe6a32ce84eeca2df58c524125ab7'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:40.901745 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Made reservation on behalf of 54afe6a32ce84eeca2df58c524125ab7 for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:04:40.909518 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:41.112819 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Allocated IP 172.20.0.2 (9cb58b73-7745-413b-a6b6-30673daa4d11/71e073e2-1e60-4ca4-a663-24a014f3734d/0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:04:41.257713 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39e6af8a-321e-4cc8-b831-5f1001ac4fe0 req-513e4ff8-b2f6-4c5d-96c2-1aad6a48f8fd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:41.259711 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-39e6af8a-321e-4cc8-b831-5f1001ac4fe0 req-513e4ff8-b2f6-4c5d-96c2-1aad6a48f8fd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0752616 Nov 18 21:04:41.340380 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-39e6af8a-321e-4cc8-b831-5f1001ac4fe0 req-950c548e-195a-4579-92ff-27b224ee8f3d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670812 Nov 18 21:04:41.353224 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcabbe04-ed91-4240-abf1-27f4ec845aaf req-8b644ba7-8522-40f2-a4fa-74d9c87b5943 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:41.355714 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dcabbe04-ed91-4240-abf1-27f4ec845aaf req-8b644ba7-8522-40f2-a4fa-74d9c87b5943 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1847093 Nov 18 21:04:41.474551 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dcabbe04-ed91-4240-abf1-27f4ec845aaf req-f418d799-097c-49d8-9318-f7d15eeb5c76 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1073654 Nov 18 21:04:41.487141 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-233ef662-baa9-4c7d-97c3-260b985a87de req-1f91d734-f5e4-4bb3-901f-2e6cfa5c0465 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 210 time: 0.0399828 Nov 18 21:04:41.492592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:41.540811 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:41.600100 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Network 9cb58b73-7745-413b-a6b6-30673daa4d11 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:04:41.603175 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:04:41.607888 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:04:41.635079 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Pushing event updated for resources: {'Port': ['ID=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:41.680334 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:41.681459 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:41.712215 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-6135d533-21bf-4526-8095-39e066962619 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9978161 Nov 18 21:04:41.741845 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Request body: {'port': {'device_id': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:04:41.806075 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:42.183105 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:04:42.199441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:42.218132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Transition to ACTIVE for port object 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:04:42.225032 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:42.306586 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Pushing event updated for resources: {'Port': ['ID=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:42.387410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Attempting to bind port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:04:42.387766 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Attempting to bind port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:04:42.388050 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Attempting to bind port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 on network 9cb58b73-7745-413b-a6b6-30673daa4d11 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:04:42.394019 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 on network 9cb58b73-7745-413b-a6b6-30673daa4d11 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:04:42.394340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Attempting to bind port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 on network 9cb58b73-7745-413b-a6b6-30673daa4d11 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:04:42.405614 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 4, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:04:42.406145 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Checking segment: {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:04:42.407936 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Bound using segment: {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:04:42.408690 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Bound port: 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:04:42.409272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:42.533138 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] For port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:04:42.556806 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6cd8344c-14e4-427f-9bb0-7fc81ee218c4 req-4b75c963-920c-4057-8c20-6273d4c70ec4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:42.558331 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6cd8344c-14e4-427f-9bb0-7fc81ee218c4 req-4b75c963-920c-4057-8c20-6273d4c70ec4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.1072760 Nov 18 21:04:42.560448 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] For port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:04:42.567962 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:42.639659 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:42.641478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:42.644762 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] 10.222.0.62 "PUT /v2.0/ports/0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 HTTP/1.1" status: 200 len: 1093 time: 0.9097154 Nov 18 21:04:42.649856 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'tag': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:42.654088 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-97ff4bfc-e636-4490-95b1-4db768e2ec55" -d '{"events": [{"name": "network-changed", "server_uuid": "34d40996-cc8c-42a7-91a1-8d0d047527d6", "tag": "0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:42.702106 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f45b8d6-ee7e-4e50-8c30-14f9ede2619f req-e14f1a8b-9be2-4198-af8f-9101408bd592 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:42.702106 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6f45b8d6-ee7e-4e50-8c30-14f9ede2619f req-e14f1a8b-9be2-4198-af8f-9101408bd592 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0992756 Nov 18 21:04:42.706512 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cb1c373-ca77-4f54-a47a-768f543ccee5 service neutron] Pushing event updated for resources: {'Port': ['ID=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:42.713518 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6cd8344c-14e4-427f-9bb0-7fc81ee218c4 req-3106ca36-50b2-49eb-8d09-d9b903cd15a7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1415739 Nov 18 21:04:42.798833 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-3c780e81-f0e2-4dc8-93d2-4f64db40dab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:42.798833 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-3c780e81-f0e2-4dc8-93d2-4f64db40dab2 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=54afe6a32ce84eeca2df58c524125ab7&device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 1096 time: 0.0628607 Nov 18 21:04:42.815126 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6f45b8d6-ee7e-4e50-8c30-14f9ede2619f req-d3464e17-f0a1-48a5-bbf9-f08a5589c12c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0928228 Nov 18 21:04:42.887330 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:42 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2191e8a8-b645-4225-bce9-3601a226b25c x-openstack-request-id: req-2191e8a8-b645-4225-bce9-3601a226b25c {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:42.887619 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "34d40996-cc8c-42a7-91a1-8d0d047527d6", "tag": "0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:42.887860 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-2191e8a8-b645-4225-bce9-3601a226b25c {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:42.888283 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'tag': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0', 'status': 'completed', 'code': 200} Nov 18 21:04:42.901406 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-9b994892-3ab7-491c-896e-732a3e02b95c service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 HTTP/1.1" status: 200 len: 217 time: 0.0843234 Nov 18 21:04:43.002793 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83629d28-234b-4543-949e-aadf3a66a946 req-6e2f73da-0de3-4a6c-9852-53ff80f97ffa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:43.004774 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83629d28-234b-4543-949e-aadf3a66a946 req-6e2f73da-0de3-4a6c-9852-53ff80f97ffa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 943 time: 0.1156855 Nov 18 21:04:43.012896 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-50eb1a5c-6a43-4914-90fc-4ab74ea994f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:43.014780 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-50eb1a5c-6a43-4914-90fc-4ab74ea994f6 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=71e073e2-1e60-4ca4-a663-24a014f3734d HTTP/1.1" status: 200 len: 853 time: 0.0806708 Nov 18 21:04:43.068161 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-a667ec39-cb9d-4538-9f49-68de75a36dc2 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=9cb58b73-7745-413b-a6b6-30673daa4d11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0326190 Nov 18 21:04:43.096953 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83629d28-234b-4543-949e-aadf3a66a946 req-3e1a7cc6-12c0-4a7d-b56d-f152d0b4827b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766706 Nov 18 21:04:43.262575 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-f37fe04d-eb25-4016-b93d-a31202144871 service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1637144 Nov 18 21:04:43.438785 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9352aa61-8186-476f-8ad0-d76deb8be4b0 req-c2539105-ccd9-47d6-861b-cd776f66323e service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1491258 Nov 18 21:04:43.636162 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-0351362c-ef24-401a-8b00-8317fc11f00e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:43.638826 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-0351362c-ef24-401a-8b00-8317fc11f00e service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=54afe6a32ce84eeca2df58c524125ab7&device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 1096 time: 0.0767612 Nov 18 21:04:43.822224 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-c9a1f3fa-1541-478d-92b1-a5503d8fb71d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:43.823474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:04:43.825456 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-c9a1f3fa-1541-478d-92b1-a5503d8fb71d service neutron] 10.222.0.62 "GET /v2.0/networks?id=9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 200 len: 914 time: 0.1760805 Nov 18 21:04:43.881634 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5b2061e-3e85-42d2-8a19-455a3fedcb14 req-a2677f3c-4f44-4c81-9ace-dcce7ede201e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:43.884214 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f5b2061e-3e85-42d2-8a19-455a3fedcb14 req-a2677f3c-4f44-4c81-9ace-dcce7ede201e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 944 time: 0.0628428 Nov 18 21:04:43.921203 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-554ca52d-7891-4424-acaf-8ecd63cbf25f service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 HTTP/1.1" status: 200 len: 217 time: 0.0782611 Nov 18 21:04:43.983908 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f5b2061e-3e85-42d2-8a19-455a3fedcb14 req-e3b282c6-f06f-4802-8175-dba5e39d0a90 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0892296 Nov 18 21:04:44.073209 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:44.090111 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-81b78253-02b2-4900-b0f7-62a28c1b366e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:44.092893 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-81b78253-02b2-4900-b0f7-62a28c1b366e service neutron] 10.222.0.62 "GET /v2.0/subnets?id=71e073e2-1e60-4ca4-a663-24a014f3734d HTTP/1.1" status: 200 len: 853 time: 0.1574430 Nov 18 21:04:44.097217 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '36578666-b0b7-4111-a019-33bc4c0ac780', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'port_id': '36578666-b0b7-4111-a019-33bc4c0ac780', 'mac_address': 'fa:16:3e:1b:e2:55', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:04:44.144584 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-7b239b9c-7790-4b39-b46d-b8a5b84c9882 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=9cb58b73-7745-413b-a6b6-30673daa4d11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0427406 Nov 18 21:04:44.157966 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-36d8f182-5f44-41d4-9f5a-0e19fbe193d5 req-a0a13df4-e14a-409f-a81a-51e5ed8f157c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:44.160395 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-36d8f182-5f44-41d4-9f5a-0e19fbe193d5 req-a0a13df4-e14a-409f-a81a-51e5ed8f157c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1667800 Nov 18 21:04:44.172548 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:44.202270 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 36578666-b0b7-4111-a019-33bc4c0ac780 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:04:44.229208 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:44.235584 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:44.295563 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=9']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:44.301515 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9299d944-5db2-4baa-9dbc-0ca43608e9d4 req-6857a0cc-9f52-4d8e-b481-0bd51c3621a4 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:44.303105 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9299d944-5db2-4baa-9dbc-0ca43608e9d4 req-6857a0cc-9f52-4d8e-b481-0bd51c3621a4 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 943 time: 0.0603473 Nov 18 21:04:44.350587 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-36d8f182-5f44-41d4-9f5a-0e19fbe193d5 req-c39c3259-53fc-476a-9731-082fb3bdf39a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1702013 Nov 18 21:04:44.399070 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9299d944-5db2-4baa-9dbc-0ca43608e9d4 req-f74c082a-04c3-4c69-926e-c93160315a7f tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0845575 Nov 18 21:04:44.416065 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-3ef1a033-141c-446e-a528-bb6d2c79a05d service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2488070 Nov 18 21:04:44.550634 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97ff4bfc-e636-4490-95b1-4db768e2ec55 req-7a8188c4-ceaf-4579-b798-76e85de31f4e service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1229866 Nov 18 21:04:45.014158 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['36578666-b0b7-4111-a019-33bc4c0ac780'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:04:45.201321 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a80ecda-e88d-4c6a-bd18-719d130e1423 req-c80460d5-59e0-4c5d-8002-224cdd0fda53 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:45.204057 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9a80ecda-e88d-4c6a-bd18-719d130e1423 req-c80460d5-59e0-4c5d-8002-224cdd0fda53 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.0892375 Nov 18 21:04:45.288462 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9a80ecda-e88d-4c6a-bd18-719d130e1423 req-8b678cc7-d885-4d39-8e74-991bcc40a521 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0741167 Nov 18 21:04:45.556675 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c6be543-c799-4b1f-a69e-a6fab7f770a4 req-74b13f30-1701-480c-afac-dd74fb66de73 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:45.559169 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8c6be543-c799-4b1f-a69e-a6fab7f770a4 req-74b13f30-1701-480c-afac-dd74fb66de73 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0786827 Nov 18 21:04:45.605295 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a8cdcce-dbf5-4572-becd-76638457afb3 req-ddc954a3-e099-4564-85df-0a69b551afa3 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:45.608150 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8a8cdcce-dbf5-4572-becd-76638457afb3 req-ddc954a3-e099-4564-85df-0a69b551afa3 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 943 time: 0.0797224 Nov 18 21:04:45.649676 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8c6be543-c799-4b1f-a69e-a6fab7f770a4 req-8f57f59b-16d1-4ead-9194-83d22df7d322 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0822530 Nov 18 21:04:45.716324 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8a8cdcce-dbf5-4572-becd-76638457afb3 req-3f631698-1b45-471c-a039-672fcb340b36 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0991797 Nov 18 21:04:45.820694 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:04:45.955134 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:45.973550 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0', 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11', 'port_id': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0', 'mac_address': 'fa:16:3e:d0:89:c9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 627, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '71e073e2-1e60-4ca4-a663-24a014f3734d', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:04:46.035807 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:46.052233 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:04:46.073162 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:46.079278 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:46.138235 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:46.472988 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d20605b-2784-47ab-8e79-d8f805084a17 req-a3de0d0f-b5d0-4de2-9bf0-d148c37658e4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:46.474683 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1d20605b-2784-47ab-8e79-d8f805084a17 req-a3de0d0f-b5d0-4de2-9bf0-d148c37658e4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.0920811 Nov 18 21:04:46.556353 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1d20605b-2784-47ab-8e79-d8f805084a17 req-d64815b4-433b-45cc-8897-ad850fe05dab tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0701778 Nov 18 21:04:46.630230 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:04:46.894499 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8143fa04-5765-40df-be76-234e6fc02aec req-43903944-6a8b-474e-a09d-153ea3cda7a6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:46.897083 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8143fa04-5765-40df-be76-234e6fc02aec req-43903944-6a8b-474e-a09d-153ea3cda7a6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0785675 Nov 18 21:04:46.929643 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3832513f-7ed0-43b9-94ee-5520e3855211 req-39094535-7d70-437d-abbb-be5188159c68 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:46.931459 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3832513f-7ed0-43b9-94ee-5520e3855211 req-39094535-7d70-437d-abbb-be5188159c68 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 944 time: 0.0767443 Nov 18 21:04:46.967331 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8143fa04-5765-40df-be76-234e6fc02aec req-2e36b46f-c57c-40b6-8cfa-af4ad4a5cb59 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0640132 Nov 18 21:04:47.008054 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3832513f-7ed0-43b9-94ee-5520e3855211 req-89ebe65f-fde3-460f-8873-3f40e68feaed tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0677857 Nov 18 21:04:47.752031 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd44ea7e-17d1-464e-b85e-e0ffd1f678ab req-a64a2f33-b6ed-47c4-bdc9-22cb01388165 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:47.754688 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd44ea7e-17d1-464e-b85e-e0ffd1f678ab req-a64a2f33-b6ed-47c4-bdc9-22cb01388165 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 945 time: 0.0780871 Nov 18 21:04:47.823067 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:04:47.846390 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dd44ea7e-17d1-464e-b85e-e0ffd1f678ab req-110c8ebf-8f48-4e7a-987b-a4333c6f4600 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0828857 Nov 18 21:04:47.894294 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 36578666-b0b7-4111-a019-33bc4c0ac780 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:04:47.894751 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:48.022705 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:48.139205 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7664e737-96b8-41eb-a31c-d34839a146a5 req-8107501f-2d58-4a38-9022-cf69ebda9247 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:48.148419 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7664e737-96b8-41eb-a31c-d34839a146a5 req-8107501f-2d58-4a38-9022-cf69ebda9247 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0722342 Nov 18 21:04:48.180747 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf80ac74-f8de-41fc-99a8-60688b7ef8d4 req-09ca677b-087c-4717-8e98-7ddaf19fdf15 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:48.183400 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bf80ac74-f8de-41fc-99a8-60688b7ef8d4 req-09ca677b-087c-4717-8e98-7ddaf19fdf15 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 944 time: 0.0754855 Nov 18 21:04:48.199958 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:48.202279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8008536b-8f61-447f-8e22-be46bc0d5f25" -d '{"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:48.217225 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7664e737-96b8-41eb-a31c-d34839a146a5 req-a8ed6b5a-89b2-4bcc-af85-1f5cb22b3043 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0672445 Nov 18 21:04:48.223954 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:48.237323 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:48.288302 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bf80ac74-f8de-41fc-99a8-60688b7ef8d4 req-e3e06e20-b1aa-4c30-9d27-7c3a47b24bae tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0935571 Nov 18 21:04:48.322868 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=10']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:48.333806 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b6d1cd50-fd94-4c13-a01b-6b05cdacced2 x-openstack-request-id: req-b6d1cd50-fd94-4c13-a01b-6b05cdacced2 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:48.334492 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-plugged", "status": "completed", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:48.334492 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b6d1cd50-fd94-4c13-a01b-6b05cdacced2 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:48.335789 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'code': 200} Nov 18 21:04:49.042133 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0de63fe6-aca6-4f9e-b3fe-0b77d65737a8 req-3ad23491-11bc-4f1b-9c1c-f95a3dc1a9fc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:49.044059 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0de63fe6-aca6-4f9e-b3fe-0b77d65737a8 req-3ad23491-11bc-4f1b-9c1c-f95a3dc1a9fc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0720458 Nov 18 21:04:49.130283 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0de63fe6-aca6-4f9e-b3fe-0b77d65737a8 req-94ae0bd1-9a77-4cb3-b9ca-5181be22bcc0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0738966 Nov 18 21:04:49.317596 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ff55608-d971-4cc4-ab45-1a24455975a6 req-d2279608-7765-44ee-af19-550177fd4ceb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:49.320258 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4ff55608-d971-4cc4-ab45-1a24455975a6 req-d2279608-7765-44ee-af19-550177fd4ceb service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1100 time: 0.0839970 Nov 18 21:04:49.347263 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:49.430052 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4ff55608-d971-4cc4-ab45-1a24455975a6 req-d8785f4e-2d37-456b-b8c9-b2a807be454e service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1006291 Nov 18 21:04:49.454914 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-94d1bb71-bbf2-4ec9-aaf8-47e5b31bd586 req-5b69e46f-9fdb-4150-b34f-0338a0a6f974 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:49.456479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-94d1bb71-bbf2-4ec9-aaf8-47e5b31bd586 req-5b69e46f-9fdb-4150-b34f-0338a0a6f974 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0921202 Nov 18 21:04:49.469448 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6517c587-00d2-41cc-b90f-1a75b1084047 req-55c0b69b-2838-4889-8b7c-2fdc80fb96d8 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:49.471574 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6517c587-00d2-41cc-b90f-1a75b1084047 req-55c0b69b-2838-4889-8b7c-2fdc80fb96d8 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 944 time: 0.0584192 Nov 18 21:04:49.538962 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6517c587-00d2-41cc-b90f-1a75b1084047 req-a5573b03-7c1a-4b5a-adad-a67ba9e96163 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599425 Nov 18 21:04:49.540448 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-94d1bb71-bbf2-4ec9-aaf8-47e5b31bd586 req-831ce44a-7f1f-4ef3-affd-fd7fbea1fd7c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0726881 Nov 18 21:04:49.823230 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:04:49.891257 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:04:49.899204 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:04:49.899807 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:50.023621 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:50.075837 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:50.084347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:50.166199 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:50.301931 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bc53901-c031-4f42-a0eb-6ba3f2d22675 req-8e1086c4-2ad6-4600-8249-d29b1473b226 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:50.303594 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9bc53901-c031-4f42-a0eb-6ba3f2d22675 req-8e1086c4-2ad6-4600-8249-d29b1473b226 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0572393 Nov 18 21:04:50.335555 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:50.338521 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-82b7cd03-d1e6-426a-a2b6-979c86ba9b43" -d '{"events": [{"server_uuid": "34d40996-cc8c-42a7-91a1-8d0d047527d6", "name": "network-vif-plugged", "status": "completed", "tag": "0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:50.375863 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9bc53901-c031-4f42-a0eb-6ba3f2d22675 req-d8203fc9-52b0-4372-a312-eb30ce81ba59 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0595307 Nov 18 21:04:50.391425 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c475036a-d304-400b-a39a-ecf640eaa453 x-openstack-request-id: req-c475036a-d304-400b-a39a-ecf640eaa453 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:50.392301 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "34d40996-cc8c-42a7-91a1-8d0d047527d6", "name": "network-vif-plugged", "status": "completed", "tag": "0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:50.392301 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c475036a-d304-400b-a39a-ecf640eaa453 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:50.393143 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0', 'code': 200} Nov 18 21:04:50.733600 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8bd40d91-1e75-414f-b578-3164e5601191 req-fa932966-9cf5-4e29-a9c5-6133dc15dab0 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:50.737594 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8bd40d91-1e75-414f-b578-3164e5601191 req-fa932966-9cf5-4e29-a9c5-6133dc15dab0 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0800073 Nov 18 21:04:50.773138 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d696a8-2596-4742-b29b-0de48a3e3d29 req-ed97a207-0465-43d8-b692-918b84224df1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:50.775715 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f9d696a8-2596-4742-b29b-0de48a3e3d29 req-ed97a207-0465-43d8-b692-918b84224df1 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 1098 time: 0.1356268 Nov 18 21:04:50.790556 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2db4579a-4ae4-45eb-9390-808546d9c269 req-e007619f-0a91-44f5-acd3-96fb87c55864 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:50.793196 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2db4579a-4ae4-45eb-9390-808546d9c269 req-e007619f-0a91-44f5-acd3-96fb87c55864 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1337817 Nov 18 21:04:50.831169 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8bd40d91-1e75-414f-b578-3164e5601191 req-55009676-7b8f-49ef-ac24-c84ebccc7c81 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0815876 Nov 18 21:04:50.893705 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f9d696a8-2596-4742-b29b-0de48a3e3d29 req-e010103a-0610-4f07-b5fa-91a4e268bac2 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0988531 Nov 18 21:04:50.925336 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2db4579a-4ae4-45eb-9390-808546d9c269 req-84b2ef4c-a772-4f41-910e-63d962598f94 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1195998 Nov 18 21:04:51.345185 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-341874e8-f068-497f-adb8-802b38076724 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0531003 Nov 18 21:04:51.448184 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-4aec9e23-5fa9-44bb-8697-756a207585ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:51.449919 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-4aec9e23-5fa9-44bb-8697-756a207585ea service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 1099 time: 0.0638330 Nov 18 21:04:51.676926 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a219be1b-c305-41f7-af03-c121817a726e req-94eb5fd3-b050-4c4c-9c10-027e9dd89620 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:51.679592 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a219be1b-c305-41f7-af03-c121817a726e req-94eb5fd3-b050-4c4c-9c10-027e9dd89620 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.1976562 Nov 18 21:04:51.712159 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ebc4e49-01df-4ef3-a8f1-c7dfc3112355 req-7891e3ec-59bf-4813-a007-9723b120e404 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:51.714755 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ebc4e49-01df-4ef3-a8f1-c7dfc3112355 req-7891e3ec-59bf-4813-a007-9723b120e404 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.2043128 Nov 18 21:04:51.745017 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-f137b01c-f78e-4ed4-a102-fe42d8e37268 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:51.746653 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-f137b01c-f78e-4ed4-a102-fe42d8e37268 service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 0.2316766 Nov 18 21:04:51.837098 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-72765027-96fd-42c2-ad0b-eb4a934b6fc0 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.14&port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d HTTP/1.1" status: 200 len: 217 time: 0.0668159 Nov 18 21:04:51.845669 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a219be1b-c305-41f7-af03-c121817a726e req-bac24ccd-703b-42b4-9c05-63d8bc0749c9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1485341 Nov 18 21:04:51.900396 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ebc4e49-01df-4ef3-a8f1-c7dfc3112355 req-914eeb61-0361-4bed-9d27-f7ae942a2cfb service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1700454 Nov 18 21:04:51.932442 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-c0cb2a58-944b-4d28-8a27-7c1e70ae66dd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:51.934796 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-c0cb2a58-944b-4d28-8a27-7c1e70ae66dd service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.0878294 Nov 18 21:04:52.002968 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33674a36-6618-4208-97f4-7fae1715fd81 req-564002ce-aa97-4cbf-ac0a-e48481f99aea tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:52.005158 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-33674a36-6618-4208-97f4-7fae1715fd81 req-564002ce-aa97-4cbf-ac0a-e48481f99aea tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0587003 Nov 18 21:04:52.082150 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-33674a36-6618-4208-97f4-7fae1715fd81 req-a97c9d3a-e796-4a0b-a33b-85266acc015a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638387 Nov 18 21:04:52.101953 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4327ce21-1658-4f62-9653-a4edd9842f02 req-12863d9d-136a-41dc-a5bc-27edbc93328b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:52.116890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4327ce21-1658-4f62-9653-a4edd9842f02 req-12863d9d-136a-41dc-a5bc-27edbc93328b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0780823 Nov 18 21:04:52.208722 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4327ce21-1658-4f62-9653-a4edd9842f02 req-51f584e9-aee7-4f22-a75e-8b18888ef83e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745692 Nov 18 21:04:52.275240 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-65458a10-6b4f-475a-bad1-5892f3756f09 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0411856 Nov 18 21:04:52.471274 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-5a9b56a3-ab13-4d0c-b4a3-69163bf427fa service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1784737 Nov 18 21:04:52.651451 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-64f8a10f-251e-46dc-9131-4cae27fc1a24 req-bfbbb69d-78dc-4ae2-a8ce-dea51109964a service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1607840 Nov 18 21:04:53.053070 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf0cf201-5fd0-49a2-8a23-3955b65b957c req-cd042397-bb3f-413c-9a74-0c5a6c5c3566 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:53.055033 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf0cf201-5fd0-49a2-8a23-3955b65b957c req-cd042397-bb3f-413c-9a74-0c5a6c5c3566 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0796149 Nov 18 21:04:53.130497 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bf0cf201-5fd0-49a2-8a23-3955b65b957c req-55687b44-2d59-491c-99fd-a2826eb627f1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0684495 Nov 18 21:04:53.300894 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef4374c3-d5ef-4778-9ada-a8dd2956e3d9 req-2b682ea9-c86f-4a1c-bdfd-0be35757bbf1 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:53.314082 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ef4374c3-d5ef-4778-9ada-a8dd2956e3d9 req-2b682ea9-c86f-4a1c-bdfd-0be35757bbf1 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0982714 Nov 18 21:04:53.433577 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ef4374c3-d5ef-4778-9ada-a8dd2956e3d9 req-282e37ed-ff17-41e6-8699-f948eb475c49 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1073139 Nov 18 21:04:53.466484 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-314f3529-73e8-49e0-b549-17626f65b56f req-9a4dcd19-0376-4075-aa23-4dfcd26603af tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:53.468959 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-314f3529-73e8-49e0-b549-17626f65b56f req-9a4dcd19-0376-4075-aa23-4dfcd26603af tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0911863 Nov 18 21:04:53.565926 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-314f3529-73e8-49e0-b549-17626f65b56f req-ba174887-9edf-4784-9b17-e9f6231870a8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853140 Nov 18 21:04:53.967732 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e185c4c-b603-407b-9c38-59871006a2ed req-cb81c34f-c9c4-4f37-9bee-3caa22651497 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:53.970112 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9e185c4c-b603-407b-9c38-59871006a2ed req-cb81c34f-c9c4-4f37-9bee-3caa22651497 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0590489 Nov 18 21:04:54.032090 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9e185c4c-b603-407b-9c38-59871006a2ed req-f170ad96-abbd-447e-966a-5c20559f0da1 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525031 Nov 18 21:04:54.343025 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dce10db0-881e-41c4-94e8-a7cba00253dc req-8d8496a9-7aca-4dc3-bad2-6fdee6bcb959 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:54.345922 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dce10db0-881e-41c4-94e8-a7cba00253dc req-8d8496a9-7aca-4dc3-bad2-6fdee6bcb959 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0908468 Nov 18 21:04:54.433791 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dce10db0-881e-41c4-94e8-a7cba00253dc req-e718cddf-dbf9-439e-967e-ff60ea45b6da tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0761144 Nov 18 21:04:54.586856 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47f0660f-3747-4462-bc45-dc96f91c246b req-de59f718-f190-455d-ba28-e96c143bbe10 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:54.588762 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-47f0660f-3747-4462-bc45-dc96f91c246b req-de59f718-f190-455d-ba28-e96c143bbe10 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0551589 Nov 18 21:04:54.675096 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-47f0660f-3747-4462-bc45-dc96f91c246b req-74d2261b-94af-41d2-b48c-f37f8ddbc04f tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0776370 Nov 18 21:04:54.757333 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54060479-5d9a-4702-96ed-68bde2e07d6e req-b9ed5457-68aa-4006-b6d9-dd2a086abccc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:54.759130 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-54060479-5d9a-4702-96ed-68bde2e07d6e req-b9ed5457-68aa-4006-b6d9-dd2a086abccc tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0959420 Nov 18 21:04:54.833654 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-54060479-5d9a-4702-96ed-68bde2e07d6e req-7c463138-251d-4ddb-aa93-3c46c44b5cd5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0599248 Nov 18 21:04:55.242817 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9847fd7e-e1bf-4358-bb12-1421dbc14575 req-34b78397-e100-4a73-99a1-9fc53b37fa93 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:55.244946 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9847fd7e-e1bf-4358-bb12-1421dbc14575 req-34b78397-e100-4a73-99a1-9fc53b37fa93 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0844531 Nov 18 21:04:55.327364 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9847fd7e-e1bf-4358-bb12-1421dbc14575 req-b72db017-c38c-49e8-a2d2-9bdadcb77530 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724804 Nov 18 21:04:56.048816 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c3e4056-94fe-4626-9e42-8ef124bf652e req-f5ac9a04-f326-4631-a681-28be362c7641 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:56.051705 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5c3e4056-94fe-4626-9e42-8ef124bf652e req-f5ac9a04-f326-4631-a681-28be362c7641 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0843153 Nov 18 21:04:56.146276 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5c3e4056-94fe-4626-9e42-8ef124bf652e req-48c821d3-1ee2-44b4-8a2c-7a6c5f832137 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0836499 Nov 18 21:04:56.508295 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41724ac2-d813-4e1f-a1f1-7cb9ecbcf500 req-bf16332c-a066-46b1-b041-1976935a8ff7 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:56.511154 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-41724ac2-d813-4e1f-a1f1-7cb9ecbcf500 req-bf16332c-a066-46b1-b041-1976935a8ff7 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0793612 Nov 18 21:04:56.604950 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-41724ac2-d813-4e1f-a1f1-7cb9ecbcf500 req-00daca58-d861-4d3c-ae5a-84fcde1a43ee tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0820286 Nov 18 21:04:57.340747 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-910f64f7-79c5-4e12-aeb8-3d19c853a316 req-00c9e8a7-b122-488c-a2a6-b6ab62afca9b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:57.343199 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-910f64f7-79c5-4e12-aeb8-3d19c853a316 req-00c9e8a7-b122-488c-a2a6-b6ab62afca9b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0822096 Nov 18 21:04:57.434864 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-910f64f7-79c5-4e12-aeb8-3d19c853a316 req-91af21ac-b265-43a1-887a-1b3b0477039b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0792103 Nov 18 21:04:57.806377 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-498740f8-c66c-42b6-9f86-7916a54f7f3e req-90968225-3061-48f2-b50a-e3fb62b1fbd4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:57.808822 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-498740f8-c66c-42b6-9f86-7916a54f7f3e req-90968225-3061-48f2-b50a-e3fb62b1fbd4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0876963 Nov 18 21:04:57.887391 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-498740f8-c66c-42b6-9f86-7916a54f7f3e req-cd02984e-9b7a-467c-9ab4-f3340768f71c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0676265 Nov 18 21:04:58.581110 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af470fb1-220a-4e4e-b045-d4006a391733 req-c0fb3231-46ba-425a-9229-59e0f03f5466 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:58.583502 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af470fb1-220a-4e4e-b045-d4006a391733 req-c0fb3231-46ba-425a-9229-59e0f03f5466 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.1049891 Nov 18 21:04:58.713439 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10e44cb5-5025-4295-ae65-3dab472ba24e req-dd532f4c-be80-4701-9ef8-1d611fe16d8b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:58.716279 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-10e44cb5-5025-4295-ae65-3dab472ba24e req-dd532f4c-be80-4701-9ef8-1d611fe16d8b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1707182 Nov 18 21:04:58.862334 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-10e44cb5-5025-4295-ae65-3dab472ba24e req-c903b980-81f0-4cc4-b60d-7a96a8ec87cf tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1001585 Nov 18 21:04:58.877193 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Deleting port e06513e6-121c-46e8-849f-16261f3ab3f8 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:04:58.877709 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:59.037047 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] For port e06513e6-121c-46e8-849f-16261f3ab3f8, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e06513e6-121c-46e8-849f-16261f3ab3f8,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:04:59.037598 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:59.056854 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Calling delete_port for e06513e6-121c-46e8-849f-16261f3ab3f8 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:04:59.100891 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51e45b29-4e7a-46be-b5f9-01caeff4b720 req-8ae9ca56-5e86-4195-9e02-6506a42a5141 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:04:59.103541 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-51e45b29-4e7a-46be-b5f9-01caeff4b720 req-8ae9ca56-5e86-4195-9e02-6506a42a5141 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 946 time: 0.0916734 Nov 18 21:04:59.173828 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-51e45b29-4e7a-46be-b5f9-01caeff4b720 req-f7358b81-ad18-4ace-a07f-070859d6f393 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0594900 Nov 18 21:04:59.294082 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:59.326932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77', '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3', 'e06513e6-121c-46e8-849f-16261f3ab3f8'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:04:59.336123 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event deleted for resources: {'Port': ['ID=e06513e6-121c-46e8-849f-16261f3ab3f8,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:04:59.349842 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.350170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.350555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.350936 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.351280 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.351624 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.351965 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.352357 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.352673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.353009 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.353342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.353686 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:04:59.416811 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] No DVR routers for this DVR port e06513e6-121c-46e8-849f-16261f3ab3f8 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:04:59.420520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:04:59.427054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af470fb1-220a-4e4e-b045-d4006a391733 req-68f864a3-a94b-4f8c-9ee9-5159c448494a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "DELETE /v2.0/ports/e06513e6-121c-46e8-849f-16261f3ab3f8 HTTP/1.1" status: 204 len: 173 time: 0.8161182 Nov 18 21:04:59.427799 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5947bb8-5332-4306-992c-c2051380d339', 'name': 'network-vif-deleted', 'tag': 'e06513e6-121c-46e8-849f-16261f3ab3f8'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:04:59.431822 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bee2e9a1-0529-4dd0-a373-7e7d95e60983" -d '{"events": [{"server_uuid": "b5947bb8-5332-4306-992c-c2051380d339", "name": "network-vif-deleted", "tag": "e06513e6-121c-46e8-849f-16261f3ab3f8"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:04:59.505370 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:04:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26e19171-39ab-4d68-8a40-20cdc833daad x-openstack-request-id: req-26e19171-39ab-4d68-8a40-20cdc833daad {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:04:59.505848 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5947bb8-5332-4306-992c-c2051380d339", "name": "network-vif-deleted", "tag": "e06513e6-121c-46e8-849f-16261f3ab3f8", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:04:59.506251 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-26e19171-39ab-4d68-8a40-20cdc833daad {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:04:59.506913 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5947bb8-5332-4306-992c-c2051380d339', 'name': 'network-vif-deleted', 'tag': 'e06513e6-121c-46e8-849f-16261f3ab3f8', 'status': 'completed', 'code': 200} Nov 18 21:05:00.036562 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d975d56-e30a-4926-ac59-85052e428ed3 req-6fec3e84-a42e-4856-93bb-805968ed3a31 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:00.038578 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d975d56-e30a-4926-ac59-85052e428ed3 req-6fec3e84-a42e-4856-93bb-805968ed3a31 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0626135 Nov 18 21:05:00.098266 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d975d56-e30a-4926-ac59-85052e428ed3 req-d31e3127-71c7-45fe-be9f-606a7efdfd0e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0529065 Nov 18 21:05:00.371470 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-34208cbf-5a41-481d-b0fa-e42058683c48 req-221d803b-cdb2-4ef4-9310-e09b6bbe5a71 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b5947bb8-5332-4306-992c-c2051380d339 HTTP/1.1" status: 200 len: 210 time: 0.0478210 Nov 18 21:05:00.654745 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-103a8cee-f227-4c10-813d-ccab4b8879d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:00.655694 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e73278af-513e-4011-91cc-cca9dfb11c3d req-b6d11d49-5cb7-47ab-a042-ad72179f503e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:00.656937 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-103a8cee-f227-4c10-813d-ccab4b8879d8 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 1099 time: 0.0494912 Nov 18 21:05:00.657523 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e73278af-513e-4011-91cc-cca9dfb11c3d req-b6d11d49-5cb7-47ab-a042-ad72179f503e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0877969 Nov 18 21:05:00.739559 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e73278af-513e-4011-91cc-cca9dfb11c3d req-3fbf546a-6247-4bd3-b5a9-52b8a1261ab3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0748780 Nov 18 21:05:00.850230 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-bc7cd2ae-ceac-42d1-b87a-12f6edbabd65 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:00.851931 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-bc7cd2ae-ceac-42d1-b87a-12f6edbabd65 service neutron] 10.222.0.62 "GET /v2.0/networks?id=5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 200 len: 920 time: 0.1606026 Nov 18 21:05:00.933274 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-3b3dc92d-556d-41c6-a0d0-059ee16bfd2b service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 200 len: 217 time: 0.0600996 Nov 18 21:05:01.030024 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-09fc06ab-0e2e-47ae-a369-1c92ac165bfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:01.033213 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-09fc06ab-0e2e-47ae-a369-1c92ac165bfa service neutron] 10.222.0.62 "GET /v2.0/subnets?id=ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 200 len: 859 time: 0.0709109 Nov 18 21:05:01.098278 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-51514b70-a638-4cfd-b94b-c64b7d7fa6f5 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=5973daa9-793c-40f5-972b-25507ee923a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0449514 Nov 18 21:05:01.230509 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-9a19a546-d10f-44fb-9585-5d09664cd20d service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1236553 Nov 18 21:05:01.344363 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1aeb6c39-881c-4e74-92c0-9fc016cbacc7 req-1425e99d-513c-406f-ba24-611a430cea9f service neutron] 10.222.0.62 "GET /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1014154 Nov 18 21:05:01.962455 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3e8e8ed-56dd-4237-9039-fdde57854f81 req-ec485d2f-39d8-4309-9c96-5fdf777ddcbe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:01.965051 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a3e8e8ed-56dd-4237-9039-fdde57854f81 req-ec485d2f-39d8-4309-9c96-5fdf777ddcbe tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0949333 Nov 18 21:05:02.055065 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a3e8e8ed-56dd-4237-9039-fdde57854f81 req-2294d5de-0077-4667-8f48-61e23032d80e tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0784330 Nov 18 21:05:02.191263 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-4c99e4b3-e555-4f85-81d2-6e838ce43480 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:03.059590 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f0e3478-2591-466b-8cf3-ad8482aa8540 req-ba096182-5e31-4cea-9c1c-bc173fa0b1b2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:03.062489 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6f0e3478-2591-466b-8cf3-ad8482aa8540 req-ba096182-5e31-4cea-9c1c-bc173fa0b1b2 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1033382 Nov 18 21:05:03.141717 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6f0e3478-2591-466b-8cf3-ad8482aa8540 req-4d9f048b-7fb0-4c54-bd4b-b1dfee68a01b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0721502 Nov 18 21:05:03.257147 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47929033-2649-4130-8015-df481256725f req-0eebaefd-e880-4ae6-813f-48ab42bba813 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:03.259871 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-47929033-2649-4130-8015-df481256725f req-0eebaefd-e880-4ae6-813f-48ab42bba813 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0807257 Nov 18 21:05:03.346812 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-47929033-2649-4130-8015-df481256725f req-715f1e7f-84de-497c-8578-74914c98d31c tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0763552 Nov 18 21:05:03.894732 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e06513e6-121c-46e8-849f-16261f3ab3f8 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:03.933330 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: e06513e6-121c-46e8-849f-16261f3ab3f8 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:03.933892 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e06513e6-121c-46e8-849f-16261f3ab3f8 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:04.302469 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c7bf3e7-1ed5-4fc4-b2a6-72a03e01830d req-3f8222c6-d9c0-4fb8-b920-5a66239e3af8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:04.304072 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8c7bf3e7-1ed5-4fc4-b2a6-72a03e01830d req-3f8222c6-d9c0-4fb8-b920-5a66239e3af8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0592904 Nov 18 21:05:04.382330 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8c7bf3e7-1ed5-4fc4-b2a6-72a03e01830d req-21f08af5-3d91-4392-b40b-837ced480ed4 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0710597 Nov 18 21:05:04.511700 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60e94215-c2f4-4e66-addc-2ba8b1e5e54b req-8d999283-759d-4e5f-a796-5056dee8f8d8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:04.513520 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-60e94215-c2f4-4e66-addc-2ba8b1e5e54b req-8d999283-759d-4e5f-a796-5056dee8f8d8 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0841513 Nov 18 21:05:04.599432 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-60e94215-c2f4-4e66-addc-2ba8b1e5e54b req-8c18afb5-1491-426b-aa7f-0dfdcd58a2e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0745964 Nov 18 21:05:04.641630 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-189c06d9-6709-41b1-8a21-4e3ef01f9b26 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:05.583369 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0df1ac4d-9f51-4595-9f8a-1090cc5363e4 req-fd54c162-d477-4308-8a78-67758fc1257d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:05.585268 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0df1ac4d-9f51-4595-9f8a-1090cc5363e4 req-fd54c162-d477-4308-8a78-67758fc1257d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.0584264 Nov 18 21:05:05.658148 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0df1ac4d-9f51-4595-9f8a-1090cc5363e4 req-15d3c47f-d0af-411f-93b4-cb39ed3b08ed tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0607460 Nov 18 21:05:05.838903 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2932359b-02b7-4388-836a-fdcedefa0565 req-41319bb5-fc9f-4871-ab18-be6b3a0b7f69 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:05.840633 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2932359b-02b7-4388-836a-fdcedefa0565 req-41319bb5-fc9f-4871-ab18-be6b3a0b7f69 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1233802 Nov 18 21:05:05.865329 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-f67f1a4d-2f2f-4a96-b7ff-f77fa6aa4e37 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:05.867621 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-f67f1a4d-2f2f-4a96-b7ff-f77fa6aa4e37 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 945 time: 0.1303666 Nov 18 21:05:05.963989 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2932359b-02b7-4388-836a-fdcedefa0565 req-ca9bba91-736d-4244-983b-9886397fed3a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1103082 Nov 18 21:05:06.005470 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:06.042627 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Deleting port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:06.042982 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:06.153089 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] For port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:06.153947 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:06.176823 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Calling delete_port for d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:06.402488 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:06.423022 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77', '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:05:06.457074 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event deleted for resources: {'Port': ['ID=d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:06.546354 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] No DVR routers for this DVR port d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:05:06.551105 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:06.557520 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e3165e6-1e67-4352-afe0-f38324ee6fd8 req-83fb2ecd-6c35-4f9a-8ad9-6c4ff5d837d8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "DELETE /v2.0/ports/d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 HTTP/1.1" status: 204 len: 173 time: 0.6753275 Nov 18 21:05:06.558267 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'name': 'network-vif-deleted', 'tag': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:05:06.563439 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0f3c194f-7daf-4b96-b36e-1b898ab43044" -d '{"events": [{"server_uuid": "c14b2cb4-f569-4e39-995a-6e45368442d5", "name": "network-vif-deleted", "tag": "d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:05:06.634677 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:05:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2afdd85a-d7cf-4bad-91f6-755355bf4e7c x-openstack-request-id: req-2afdd85a-d7cf-4bad-91f6-755355bf4e7c {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:05:06.635150 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c14b2cb4-f569-4e39-995a-6e45368442d5", "name": "network-vif-deleted", "tag": "d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:05:06.635567 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-2afdd85a-d7cf-4bad-91f6-755355bf4e7c {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:05:06.636227 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c14b2cb4-f569-4e39-995a-6e45368442d5', 'name': 'network-vif-deleted', 'tag': 'd6082ed2-14fd-40ce-bb12-7a8f63a3a2d3', 'status': 'completed', 'code': 200} Nov 18 21:05:06.820396 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f523a5bc-42b8-4372-8c94-714c97a7e42d req-3f9820dd-05d3-4d94-909c-24cf145c29e0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=c14b2cb4-f569-4e39-995a-6e45368442d5 HTTP/1.1" status: 200 len: 210 time: 0.0325906 Nov 18 21:05:07.468876 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:08.239626 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a378404-af19-47ba-9bc5-4bc812a43799 req-c332e19c-9265-4a0c-a044-37a5656f4fe0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:08.242205 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5a378404-af19-47ba-9bc5-4bc812a43799 req-c332e19c-9265-4a0c-a044-37a5656f4fe0 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.0830164 Nov 18 21:05:08.260815 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:08.331784 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5a378404-af19-47ba-9bc5-4bc812a43799 req-2f704d0f-8106-461d-9545-9f53455579cf tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0806987 Nov 18 21:05:09.514843 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec02bb79-ca19-4da0-b8c9-397d239ac9e7 req-f136779f-7c31-42ab-9778-cbfcfd00ef27 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:09.516863 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ec02bb79-ca19-4da0-b8c9-397d239ac9e7 req-f136779f-7c31-42ab-9778-cbfcfd00ef27 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.0823832 Nov 18 21:05:09.870389 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ec02bb79-ca19-4da0-b8c9-397d239ac9e7 req-6b7227f5-e20e-4bbf-974d-7fad6c33083c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3428824 Nov 18 21:05:09.913287 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:09.941778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:09.942043 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device d6082ed2-14fd-40ce-bb12-7a8f63a3a2d3 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:10.670950 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-8a49d03f-97a9-473f-b4f6-16ac56d317cf tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:10.676494 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-8a49d03f-97a9-473f-b4f6-16ac56d317cf tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.0566866 Nov 18 21:05:10.766610 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:05:10.794990 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Deleting port 76221db7-7a26-4eba-b39a-1b8a36a04f16 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:10.795318 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:10.926029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] For port 76221db7-7a26-4eba-b39a-1b8a36a04f16, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=76221db7-7a26-4eba-b39a-1b8a36a04f16,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:10.926526 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:10.943971 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Calling delete_port for 76221db7-7a26-4eba-b39a-1b8a36a04f16 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:11.080385 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-196e3d24-3b54-4012-baa8-fa5427b5905b req-91b096dd-1c4e-4915-b45c-e276be9e4d19 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:11.084686 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-196e3d24-3b54-4012-baa8-fa5427b5905b req-91b096dd-1c4e-4915-b45c-e276be9e4d19 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=b7abb666-bcb4-421d-97b8-4cc7bc73f17e HTTP/1.1" status: 200 len: 945 time: 0.0843220 Nov 18 21:05:11.150353 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:11.170115 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77', '76221db7-7a26-4eba-b39a-1b8a36a04f16'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:05:11.175916 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-196e3d24-3b54-4012-baa8-fa5427b5905b req-df022a33-0d7e-408d-8eda-cef69a4ef264 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828261 Nov 18 21:05:11.218333 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event deleted for resources: {'Port': ['ID=76221db7-7a26-4eba-b39a-1b8a36a04f16,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:11.281386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] No DVR routers for this DVR port 76221db7-7a26-4eba-b39a-1b8a36a04f16 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:05:11.284462 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:11.287777 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2540d430-c961-46ce-8dde-7d5114e29d9d req-bc20542c-833b-468f-98a1-beb163ad711c tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "DELETE /v2.0/ports/76221db7-7a26-4eba-b39a-1b8a36a04f16 HTTP/1.1" status: 204 len: 173 time: 0.6039951 Nov 18 21:05:11.288310 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'name': 'network-vif-deleted', 'tag': '76221db7-7a26-4eba-b39a-1b8a36a04f16'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:05:11.290612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ecbfdf9-4297-4c96-915e-20c9de57161e" -d '{"events": [{"server_uuid": "b7abb666-bcb4-421d-97b8-4cc7bc73f17e", "name": "network-vif-deleted", "tag": "76221db7-7a26-4eba-b39a-1b8a36a04f16"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:05:11.367134 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:05:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5900944b-5c69-4b46-92d4-962eea1cab23 x-openstack-request-id: req-5900944b-5c69-4b46-92d4-962eea1cab23 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:05:11.367540 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b7abb666-bcb4-421d-97b8-4cc7bc73f17e", "name": "network-vif-deleted", "tag": "76221db7-7a26-4eba-b39a-1b8a36a04f16", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:05:11.367998 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5900944b-5c69-4b46-92d4-962eea1cab23 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:05:11.369418 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b7abb666-bcb4-421d-97b8-4cc7bc73f17e', 'name': 'network-vif-deleted', 'tag': '76221db7-7a26-4eba-b39a-1b8a36a04f16', 'status': 'completed', 'code': 200} Nov 18 21:05:11.524097 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e798514-9dcb-4eb2-875a-bb028aea1895 req-34347c94-217d-49d6-a70b-93676f4f9df3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:11.526508 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e798514-9dcb-4eb2-875a-bb028aea1895 req-34347c94-217d-49d6-a70b-93676f4f9df3 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0813580 Nov 18 21:05:11.598022 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e798514-9dcb-4eb2-875a-bb028aea1895 req-198d5445-e1af-4bf6-b017-d4c16de2375a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0624933 Nov 18 21:05:12.801798 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e6c04aab-d510-4d82-950b-2dc720efa330 req-b38468e2-7a5a-4f4a-836f-7fc480edd1a5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:12.804066 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e6c04aab-d510-4d82-950b-2dc720efa330 req-b38468e2-7a5a-4f4a-836f-7fc480edd1a5 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0962102 Nov 18 21:05:12.884702 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e6c04aab-d510-4d82-950b-2dc720efa330 req-9a8b8360-5abb-458d-8364-6500e5959f02 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0669515 Nov 18 21:05:13.732547 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f01cd27-ca55-46f0-b6d2-21a098b4fbb7 req-03d1abff-e364-4f02-9072-1a8864cbf28b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:13.734214 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f01cd27-ca55-46f0-b6d2-21a098b4fbb7 req-03d1abff-e364-4f02-9072-1a8864cbf28b tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0701036 Nov 18 21:05:13.820940 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2f01cd27-ca55-46f0-b6d2-21a098b4fbb7 req-606fc806-34fd-4d02-bea3-5ca2c2d46e1d tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766189 Nov 18 21:05:14.081160 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-384d58f4-c0db-49c9-b133-cb45b014a2b1 req-95f59bc9-f915-4ffe-85d6-2a5b18d65c77 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:14.082741 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-384d58f4-c0db-49c9-b133-cb45b014a2b1 req-95f59bc9-f915-4ffe-85d6-2a5b18d65c77 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0755329 Nov 18 21:05:14.143495 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-384d58f4-c0db-49c9-b133-cb45b014a2b1 req-dac97a4d-bfce-4624-af3c-5ee4b10c5e73 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0496993 Nov 18 21:05:15.003375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a69486ab-7bba-404a-8b07-f3f575b70c8a req-59b26cbb-188b-40b6-a437-72596dac8820 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:15.006233 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a69486ab-7bba-404a-8b07-f3f575b70c8a req-59b26cbb-188b-40b6-a437-72596dac8820 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0946655 Nov 18 21:05:15.094042 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a69486ab-7bba-404a-8b07-f3f575b70c8a req-c9c11f77-0bb7-42d7-a403-204b0b2efa6a tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0788002 Nov 18 21:05:15.316520 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-727b0414-2f62-44ea-82ca-9d79cc1caac5 req-8cd9962b-5c64-42f7-8a39-19f9e187b5a1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:15.318521 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-727b0414-2f62-44ea-82ca-9d79cc1caac5 req-8cd9962b-5c64-42f7-8a39-19f9e187b5a1 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0667262 Nov 18 21:05:15.382906 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-727b0414-2f62-44ea-82ca-9d79cc1caac5 req-f1e04843-f9ab-482a-9835-638290520084 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0542619 Nov 18 21:05:15.438740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-573ff4d1-a4e4-4212-ba9f-ade60b37abea tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:15.440483 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-573ff4d1-a4e4-4212-ba9f-ade60b37abea tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 946 time: 0.0754628 Nov 18 21:05:15.584945 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Deleting port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:15.585329 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:15.715695 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] For port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:15.716064 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:15.746336 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Calling delete_port for 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:15.932994 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 76221db7-7a26-4eba-b39a-1b8a36a04f16 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:15.965397 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 76221db7-7a26-4eba-b39a-1b8a36a04f16 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:15.965816 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 76221db7-7a26-4eba-b39a-1b8a36a04f16 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:15.975946 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:15.995634 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['618d8033-6b64-42ec-805f-1007401fc720', '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:05:16.019376 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Pushing event deleted for resources: {'Port': ['ID=972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:16.090893 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] No DVR routers for this DVR port 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:05:16.093826 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:16.097661 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4efc28c2-1361-4c1b-8e62-0c309e4dda26 req-396411a9-954b-4aa4-8179-ad6ea73a2439 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "DELETE /v2.0/ports/972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d HTTP/1.1" status: 204 len: 173 time: 0.6404488 Nov 18 21:05:16.098153 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '3434e796-377f-4682-8853-5949c8a1e5f3', 'name': 'network-vif-deleted', 'tag': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:05:16.100631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8a64b84a-ff2f-4f08-a4be-88aedad3289c" -d '{"events": [{"server_uuid": "3434e796-377f-4682-8853-5949c8a1e5f3", "name": "network-vif-deleted", "tag": "972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:05:16.185597 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:05:16 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5729876-5a88-47c9-8333-d5acd4ecf268 x-openstack-request-id: req-b5729876-5a88-47c9-8333-d5acd4ecf268 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:05:16.186244 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "3434e796-377f-4682-8853-5949c8a1e5f3", "name": "network-vif-deleted", "tag": "972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:05:16.186753 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b5729876-5a88-47c9-8333-d5acd4ecf268 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:05:16.187599 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '3434e796-377f-4682-8853-5949c8a1e5f3', 'name': 'network-vif-deleted', 'tag': '972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d', 'status': 'completed', 'code': 200} Nov 18 21:05:16.335775 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f2644f8-11a2-49cb-9290-d8dcca5abb66 req-8e5436a6-5063-4484-bb24-250ef9735cc3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:16.338383 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0f2644f8-11a2-49cb-9290-d8dcca5abb66 req-8e5436a6-5063-4484-bb24-250ef9735cc3 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0777001 Nov 18 21:05:16.415980 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0f2644f8-11a2-49cb-9290-d8dcca5abb66 req-b0db949a-5c73-4221-80fa-a8db9a115348 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/security-groups?id=d662157f-d131-4a4f-9901-a31465806480&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0686600 Nov 18 21:05:16.534003 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-86b29e38-59fe-4a73-9e86-0fc0d0d7203c req-82713b1e-fe0e-44f0-a9b1-caaf42b75af6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=3434e796-377f-4682-8853-5949c8a1e5f3 HTTP/1.1" status: 200 len: 210 time: 0.0396533 Nov 18 21:05:16.728018 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-d7c70e6a-14b5-40dc-a8ce-422acf1a29c8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:16.729872 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-d7c70e6a-14b5-40dc-a8ce-422acf1a29c8 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 945 time: 0.0635304 Nov 18 21:05:16.887874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Deleting port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:16.888294 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:17.066469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] For port 67b470ac-d502-4785-a1b3-cabbdf1eaf77, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=67b470ac-d502-4785-a1b3-cabbdf1eaf77,segment=NetworkSegment(26679146-5e5a-421c-8b63-f1f783adcc41),segment_id=26679146-5e5a-421c-8b63-f1f783adcc41)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:17.067202 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:17.091597 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Calling delete_port for 67b470ac-d502-4785-a1b3-cabbdf1eaf77 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:17.277101 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:17.296611 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['67b470ac-d502-4785-a1b3-cabbdf1eaf77'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:05:17.309902 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Pushing event deleted for resources: {'Port': ['ID=67b470ac-d502-4785-a1b3-cabbdf1eaf77,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:17.373194 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] No DVR routers for this DVR port 67b470ac-d502-4785-a1b3-cabbdf1eaf77 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:05:17.376186 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:17.379681 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ae07c08-6631-4bf5-a2eb-8bf0dd05ef8f req-767b2502-9a4e-482b-bdad-705b4671ad82 tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.62 "DELETE /v2.0/ports/67b470ac-d502-4785-a1b3-cabbdf1eaf77 HTTP/1.1" status: 204 len: 173 time: 0.6414421 Nov 18 21:05:17.554351 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eb04b052-fc57-43f6-b7e1-8974b79e5cea req-02be6a4f-0fa4-4522-b03b-4fcaa68ef01f tempest-AttachVolumeNegativeTest-1158524739 tempest-AttachVolumeNegativeTest-1158524739-project] 10.222.0.61 "GET /v2.0/ports?device_id=372b6983-3b61-4ecd-a186-2a7e7adbcf37 HTTP/1.1" status: 200 len: 210 time: 0.0428550 Nov 18 21:05:17.942435 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edcea3ac-a743-49eb-ac18-b05ac8c55627 req-23d620f9-6e15-45e4-afac-3817add30e4b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:17.944062 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-edcea3ac-a743-49eb-ac18-b05ac8c55627 req-23d620f9-6e15-45e4-afac-3817add30e4b tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0615861 Nov 18 21:05:18.005240 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-edcea3ac-a743-49eb-ac18-b05ac8c55627 req-f06cced2-c9f2-408d-80af-3b60af2f55d0 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0502040 Nov 18 21:05:18.188847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'name': 'network-vif-deleted', 'tag': '67b470ac-d502-4785-a1b3-cabbdf1eaf77'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:05:18.192708 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-62cba0f8-7d4b-4fd5-8f73-e0839ac9ac95" -d '{"events": [{"server_uuid": "372b6983-3b61-4ecd-a186-2a7e7adbcf37", "name": "network-vif-deleted", "tag": "67b470ac-d502-4785-a1b3-cabbdf1eaf77"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:05:18.243887 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:05:18 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e71956b5-e69c-49e8-b889-8677993362d3 x-openstack-request-id: req-e71956b5-e69c-49e8-b889-8677993362d3 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:05:18.244403 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "372b6983-3b61-4ecd-a186-2a7e7adbcf37", "name": "network-vif-deleted", "tag": "67b470ac-d502-4785-a1b3-cabbdf1eaf77", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:05:18.244985 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-e71956b5-e69c-49e8-b889-8677993362d3 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:05:18.245634 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '372b6983-3b61-4ecd-a186-2a7e7adbcf37', 'name': 'network-vif-deleted', 'tag': '67b470ac-d502-4785-a1b3-cabbdf1eaf77', 'status': 'completed', 'code': 200} Nov 18 21:05:18.622578 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 38828) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:18.692369 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Deleting subnet fcebaf13-b181-404f-a8e5-52ddbe0c8c7c {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:05:18.697707 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:18.747399 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:18.802671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:18.878203 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:18.918649 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fcebaf13-b181-404f-a8e5-52ddbe0c8c7c,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:18.924415 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:18.929815 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7e7db2c6-e739-4db9-a2dd-8b7d3e0657f3 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/fcebaf13-b181-404f-a8e5-52ddbe0c8c7c HTTP/1.1" status: 204 len: 168 time: 0.3060100 Nov 18 21:05:18.933901 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 38830) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:19.032188 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.182542 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.211607 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['2d6a6844-15e6-4a14-9103-24e890fa190f']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:19.226548 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '26679146-5e5a-421c-8b63-f1f783adcc41') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:19.226983 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '26679146-5e5a-421c-8b63-f1f783adcc41') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:19.237332 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7999b1a-ca6f-467c-909c-dd9e35f55048 req-3bbfaac4-8465-477d-ae3e-50dc7f27239a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:19.238918 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7999b1a-ca6f-467c-909c-dd9e35f55048 req-3bbfaac4-8465-477d-ae3e-50dc7f27239a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.1103375 Nov 18 21:05:19.249628 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.278685 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.293698 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Releasing vlan 604 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:05:19.294188 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:05:19.295988 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:05:19.334173 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.354016 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c7999b1a-ca6f-467c-909c-dd9e35f55048 req-4b9c7a64-6db9-4262-88d1-ec8678afc0c7 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1070077 Nov 18 21:05:19.379637 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.386846 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.395039 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] 10.222.0.61 "DELETE /v2.0/networks/2d6a6844-15e6-4a14-9103-24e890fa190f HTTP/1.1" status: 204 len: 168 time: 0.4542320 Nov 18 21:05:19.403324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Pushing event deleted for resources: {'Network': ['ID=2d6a6844-15e6-4a14-9103-24e890fa190f,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.419569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3557d00a-8b3e-42b6-9848-87b83d72bac1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:19.551567 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 38840) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:19.601392 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b4230f33-3641-487b-9e8a-cc45e2944ad7 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=05431e285025437d8783475290b4e4fc&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0481658 Nov 18 21:05:19.603842 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 38842) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:19.692793 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d4302c7-1940-4483-8630-73ea9e350012 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.730987 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d4302c7-1940-4483-8630-73ea9e350012 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.792030 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d4302c7-1940-4483-8630-73ea9e350012 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.795392 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d4302c7-1940-4483-8630-73ea9e350012 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:19.796898 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9d4302c7-1940-4483-8630-73ea9e350012 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/d662157f-d131-4a4f-9901-a31465806480 HTTP/1.1" status: 204 len: 168 time: 0.1914494 Nov 18 21:05:19.805609 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d4302c7-1940-4483-8630-73ea9e350012 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d662157f-d131-4a4f-9901-a31465806480,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:19.950037 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:19.993582 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:19.994108 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 972bf4ff-85aa-4b2a-b2c3-24b42ad1b63d not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:19.994857 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 67b470ac-d502-4785-a1b3-cabbdf1eaf77 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:20.017291 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 67b470ac-d502-4785-a1b3-cabbdf1eaf77 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:20.017645 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 67b470ac-d502-4785-a1b3-cabbdf1eaf77 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:20.555185 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7ba9e8ca-8b2b-42e9-a3a9-c4a5670e6656 req-a48dbb4b-774f-45c0-8302-f01b54cb2d3a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:20.556766 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ba9e8ca-8b2b-42e9-a3a9-c4a5670e6656 req-a48dbb4b-774f-45c0-8302-f01b54cb2d3a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0783401 Nov 18 21:05:20.662783 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7ba9e8ca-8b2b-42e9-a3a9-c4a5670e6656 req-4f05d0fa-f04b-46b7-8e04-d20a7565cf75 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0908871 Nov 18 21:05:21.857717 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22af36fa-a95c-4b96-bc80-2226bf2aa057 req-42022e2f-2249-484b-b267-31d8224e5243 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:21.859732 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-22af36fa-a95c-4b96-bc80-2226bf2aa057 req-42022e2f-2249-484b-b267-31d8224e5243 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0802705 Nov 18 21:05:21.932853 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-22af36fa-a95c-4b96-bc80-2226bf2aa057 req-27380953-5ae1-4024-bdee-645342bd0a33 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0625668 Nov 18 21:05:23.081911 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02c283d4-c703-41c9-ba90-4c57e0376b2d req-68e3f6bf-6ec2-447f-9bcf-c9618b688d57 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:23.083473 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-02c283d4-c703-41c9-ba90-4c57e0376b2d req-68e3f6bf-6ec2-447f-9bcf-c9618b688d57 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0700490 Nov 18 21:05:23.167196 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-02c283d4-c703-41c9-ba90-4c57e0376b2d req-4084ffb5-d6d8-4acc-8fc0-2138e24d48c9 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0715542 Nov 18 21:05:24.319401 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58e8108b-dba2-444a-867f-ca6e52c3f20f req-4ae64c8f-4091-4310-afb1-ca134ee195e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:24.321376 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-58e8108b-dba2-444a-867f-ca6e52c3f20f req-4ae64c8f-4091-4310-afb1-ca134ee195e6 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0740075 Nov 18 21:05:24.361459 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43e22e73-91a2-4397-bd39-acc6f1583b1d req-db0fcdcf-7052-48e2-9efd-ed4459530dc8 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:24.363640 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43e22e73-91a2-4397-bd39-acc6f1583b1d req-db0fcdcf-7052-48e2-9efd-ed4459530dc8 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0764508 Nov 18 21:05:24.392185 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-58e8108b-dba2-444a-867f-ca6e52c3f20f req-a1c1fb7b-8eba-4095-bfc7-165e902d3040 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638232 Nov 18 21:05:24.460675 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43e22e73-91a2-4397-bd39-acc6f1583b1d req-57b77de2-ae0f-4eb1-9c90-beb78bc82689 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0893652 Nov 18 21:05:25.574682 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4af21f4-bc02-4db1-a7cb-29945df74b7f req-392d50e1-4246-4a1b-9401-b09f70247c75 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:25.576510 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c4af21f4-bc02-4db1-a7cb-29945df74b7f req-392d50e1-4246-4a1b-9401-b09f70247c75 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0738418 Nov 18 21:05:25.614911 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d078e7a8-0a49-47ba-9a6a-45592f751326 req-50014ce8-4ab0-478e-aa5f-9ccf5665b105 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:25.617183 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d078e7a8-0a49-47ba-9a6a-45592f751326 req-50014ce8-4ab0-478e-aa5f-9ccf5665b105 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0789409 Nov 18 21:05:25.655950 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c4af21f4-bc02-4db1-a7cb-29945df74b7f req-4e74f9ab-d771-4b17-968a-45c384147b04 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0711257 Nov 18 21:05:25.721590 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d078e7a8-0a49-47ba-9a6a-45592f751326 req-c6852e4d-54a7-440f-aa0a-aad460f44d89 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0931792 Nov 18 21:05:26.486514 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-84277073-3b89-4791-b9cb-43231c0bad41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:26.488092 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-84277073-3b89-4791-b9cb-43231c0bad41 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1137 time: 0.0593388 Nov 18 21:05:26.626555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-d1e4c814-30d8-4efc-a93a-45e2197191ce service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:26.628630 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-d1e4c814-30d8-4efc-a93a-45e2197191ce service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.1177938 Nov 18 21:05:26.775002 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-38d2201e-3480-494d-8cfc-a42b295d49c3 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 1000 time: 0.1340036 Nov 18 21:05:26.877837 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-2d11effe-e7c1-4b6e-a702-be8546b4f6c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:26.882556 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3b032a-0230-4a60-a28d-e007b5ae3f1f req-ac6a5c02-6bff-4cb9-946f-649d85d4fc5a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:26.884229 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ab3b032a-0230-4a60-a28d-e007b5ae3f1f req-ac6a5c02-6bff-4cb9-946f-649d85d4fc5a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0714962 Nov 18 21:05:26.887657 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-2d11effe-e7c1-4b6e-a702-be8546b4f6c8 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.0970352 Nov 18 21:05:26.946410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6ae2cc3-93b8-4be7-a40b-1eaac5ed841f req-4bc49017-46b5-46c1-99e0-28be6ecd56b4 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:26.947947 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6ae2cc3-93b8-4be7-a40b-1eaac5ed841f req-4bc49017-46b5-46c1-99e0-28be6ecd56b4 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1173358 Nov 18 21:05:26.958545 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ab3b032a-0230-4a60-a28d-e007b5ae3f1f req-a8685c74-dc80-4fbf-a932-b17b92b7be2d tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0658112 Nov 18 21:05:26.980254 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-415d414c-169e-4c02-bac9-a4e26981e8be service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:26.981932 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-415d414c-169e-4c02-bac9-a4e26981e8be service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0835519 Nov 18 21:05:27.087195 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6ae2cc3-93b8-4be7-a40b-1eaac5ed841f req-cce257d7-d6ed-45f5-907f-045f0ead411d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1282351 Nov 18 21:05:27.133715 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-0c092fec-c75c-4463-9ef7-e0dc68e640e5 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1325459 Nov 18 21:05:27.292028 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f52eb0bd-d57f-4ee8-bfe2-751877d83bf8 req-92b17743-e6ee-4ad3-b0d4-3de824d14af4 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1450362 Nov 18 21:05:28.122536 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b2385ba-6114-4c99-acd9-9d5daf9f34eb req-d4bf2513-74da-483f-bd63-7741ba421421 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:28.124950 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1b2385ba-6114-4c99-acd9-9d5daf9f34eb req-d4bf2513-74da-483f-bd63-7741ba421421 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0744097 Nov 18 21:05:28.200957 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1b2385ba-6114-4c99-acd9-9d5daf9f34eb req-a5f29382-43c1-4a0c-b623-0b09e4607bb9 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649607 Nov 18 21:05:28.276878 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f425d455-68a9-438f-9286-53dbb4bd2e11 req-28d0c77f-216b-4f4d-bead-c0784090b078 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:28.278480 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f425d455-68a9-438f-9286-53dbb4bd2e11 req-28d0c77f-216b-4f4d-bead-c0784090b078 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0686469 Nov 18 21:05:28.392964 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f425d455-68a9-438f-9286-53dbb4bd2e11 req-c7ae95e5-7433-481c-971e-521a34d622a3 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1020489 Nov 18 21:05:29.296977 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-08ee5199-b95d-4982-9467-5c2e383f857f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:29.299154 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-08ee5199-b95d-4982-9467-5c2e383f857f tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0765421 Nov 18 21:05:29.387956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39046) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:29.393413 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2374c66e-375e-4083-a644-1899ac85dac1 req-f00a6db7-46e3-4d35-ad91-e0dc72466742 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:29.396608 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2374c66e-375e-4083-a644-1899ac85dac1 req-f00a6db7-46e3-4d35-ad91-e0dc72466742 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 946 time: 0.0823271 Nov 18 21:05:29.457658 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Deleting port 618d8033-6b64-42ec-805f-1007401fc720 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:29.460702 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:29.502199 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2374c66e-375e-4083-a644-1899ac85dac1 req-c4de6010-25ac-4263-a698-a6d694fc4377 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/security-groups?id=827e81d5-c5d1-4ee0-9f96-e195ef77902b&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0994840 Nov 18 21:05:29.594853 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5a8d62e0-0a96-42c8-92f5-658d43621222 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:29.640716 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] For port 618d8033-6b64-42ec-805f-1007401fc720, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=618d8033-6b64-42ec-805f-1007401fc720,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:29.641145 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:29.667390 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Calling delete_port for 618d8033-6b64-42ec-805f-1007401fc720 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:29.680190 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f33a0445-edab-4a91-83e3-3aa071934f8f req-acf8ac79-41e3-4ea4-a2cd-d993880f36e4 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:29.681850 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f33a0445-edab-4a91-83e3-3aa071934f8f req-acf8ac79-41e3-4ea4-a2cd-d993880f36e4 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1538086 Nov 18 21:05:29.870076 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f33a0445-edab-4a91-83e3-3aa071934f8f req-fb136639-4e22-462f-8de2-e3513aaa8e7d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1702213 Nov 18 21:05:29.887176 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5a8d62e0-0a96-42c8-92f5-658d43621222 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:29.895732 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5a8d62e0-0a96-42c8-92f5-658d43621222 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:29.979136 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5a8d62e0-0a96-42c8-92f5-658d43621222 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=339f4885-d00c-48c0-ad8a-c6199868a876,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:29.991893 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5a8d62e0-0a96-42c8-92f5-658d43621222 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=f0761078eb5f4231ad1a15139aa39376&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5988305 Nov 18 21:05:29.993036 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39072) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:30.019609 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.038505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['618d8033-6b64-42ec-805f-1007401fc720'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:05:30.062342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Pushing event deleted for resources: {'Port': ['ID=618d8033-6b64-42ec-805f-1007401fc720,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:30.067022 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0ab3d9c-4f1b-476b-997a-c5878f245f9d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.093158 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0ab3d9c-4f1b-476b-997a-c5878f245f9d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.122571 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39074) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:30.126874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] No DVR routers for this DVR port 618d8033-6b64-42ec-805f-1007401fc720 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:05:30.130342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.136924 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b484c5c9-374d-4c99-b47e-33c5225c033c req-c4c46db8-e488-48a3-b805-9c3a8e94a48a tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.62 "DELETE /v2.0/ports/618d8033-6b64-42ec-805f-1007401fc720 HTTP/1.1" status: 204 len: 173 time: 0.8282681 Nov 18 21:05:30.137715 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'name': 'network-vif-deleted', 'tag': '618d8033-6b64-42ec-805f-1007401fc720'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:05:30.142058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6398159d-516d-4e22-88d0-7a7fab79ffb0" -d '{"events": [{"server_uuid": "6956f4de-9dd5-4438-a7d9-fb2e1b228343", "name": "network-vif-deleted", "tag": "618d8033-6b64-42ec-805f-1007401fc720"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:05:30.183207 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0ab3d9c-4f1b-476b-997a-c5878f245f9d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.189849 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0ab3d9c-4f1b-476b-997a-c5878f245f9d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.191885 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c0ab3d9c-4f1b-476b-997a-c5878f245f9d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/339f4885-d00c-48c0-ad8a-c6199868a876 HTTP/1.1" status: 204 len: 168 time: 0.1984591 Nov 18 21:05:30.208739 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:05:30 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-94ba91a8-8b7a-4402-ab1a-c9fd5f78bbca x-openstack-request-id: req-94ba91a8-8b7a-4402-ab1a-c9fd5f78bbca {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:05:30.209479 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6956f4de-9dd5-4438-a7d9-fb2e1b228343", "name": "network-vif-deleted", "tag": "618d8033-6b64-42ec-805f-1007401fc720", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:05:30.209842 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-94ba91a8-8b7a-4402-ab1a-c9fd5f78bbca {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:05:30.210429 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6956f4de-9dd5-4438-a7d9-fb2e1b228343', 'name': 'network-vif-deleted', 'tag': '618d8033-6b64-42ec-805f-1007401fc720', 'status': 'completed', 'code': 200} Nov 18 21:05:30.217555 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0ab3d9c-4f1b-476b-997a-c5878f245f9d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=339f4885-d00c-48c0-ad8a-c6199868a876,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:30.320620 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6cc06c1c-90b3-46ca-9953-e3b3e806c69c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.461196 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6cc06c1c-90b3-46ca-9953-e3b3e806c69c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.469849 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6cc06c1c-90b3-46ca-9953-e3b3e806c69c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.515703 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc06c1c-90b3-46ca-9953-e3b3e806c69c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0c280319-4996-41ff-9176-3ed5646c92cd,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:30.524785 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6cc06c1c-90b3-46ca-9953-e3b3e806c69c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3f5206afbe264481bca48ca1a3e90a9e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4010725 Nov 18 21:05:30.528879 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39086) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:30.602417 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05db2933-b081-46b1-94bb-162520f76483 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.646127 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05db2933-b081-46b1-94bb-162520f76483 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.673775 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2e1d5f92-dd99-4796-aada-3304a1050650 req-844ffb21-a7aa-489b-aeb2-9d9bdc7bde53 tempest-ServerRescueNegativeTestJSON-985856957 tempest-ServerRescueNegativeTestJSON-985856957-project] 10.222.0.61 "GET /v2.0/ports?device_id=6956f4de-9dd5-4438-a7d9-fb2e1b228343 HTTP/1.1" status: 200 len: 210 time: 0.0389814 Nov 18 21:05:30.739071 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05db2933-b081-46b1-94bb-162520f76483 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.743736 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-05db2933-b081-46b1-94bb-162520f76483 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:30.745521 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-05db2933-b081-46b1-94bb-162520f76483 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/0c280319-4996-41ff-9176-3ed5646c92cd HTTP/1.1" status: 204 len: 168 time: 0.2144780 Nov 18 21:05:30.757410 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-05db2933-b081-46b1-94bb-162520f76483 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0c280319-4996-41ff-9176-3ed5646c92cd,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:31.157901 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a1a9a61-5c78-453e-a87e-9c6ae0861b6e req-be180794-24e0-4298-ab78-d0ed06cd060a tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:31.161001 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7a1a9a61-5c78-453e-a87e-9c6ae0861b6e req-be180794-24e0-4298-ab78-d0ed06cd060a tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1010425 Nov 18 21:05:31.259276 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7a1a9a61-5c78-453e-a87e-9c6ae0861b6e req-30ace169-7865-4c50-9375-a998ce6d16b2 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0934258 Nov 18 21:05:31.751709 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39142) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:32.193429 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7fffa5c4-9627-4047-a271-0f9b2709a787 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:32.455717 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5966524-b127-4147-8af4-49db7aa78209 req-3f09e1ed-0679-4efb-a840-c7ef5a329e4f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:32.459290 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d5966524-b127-4147-8af4-49db7aa78209 req-3f09e1ed-0679-4efb-a840-c7ef5a329e4f tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0873499 Nov 18 21:05:32.562844 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d5966524-b127-4147-8af4-49db7aa78209 req-acbe4260-1b65-4ebe-a0d6-6ba5807a4eed tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0938270 Nov 18 21:05:32.619172 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:33.010624 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Deleting port 3cefd565-3646-40ee-9393-8f0787133ebb {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:33.011469 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:33.116505 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] For port 3cefd565-3646-40ee-9393-8f0787133ebb, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=3cefd565-3646-40ee-9393-8f0787133ebb,segment=NetworkSegment(346175a8-8f3b-4db0-acce-2b22e5308fa2),segment_id=346175a8-8f3b-4db0-acce-2b22e5308fa2)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:33.117135 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:33.134419 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Calling delete_port for 3cefd565-3646-40ee-9393-8f0787133ebb owned by network:router_interface {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:33.370154 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:33.398355 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Pushing event deleted for resources: {'Port': ['ID=3cefd565-3646-40ee-9393-8f0787133ebb,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:33.657607 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:33.774633 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4decdef-8361-4a41-900e-d44500083b23 req-7e02e5c4-4a16-4383-afa8-03f19ac30648 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:33.777474 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b4decdef-8361-4a41-900e-d44500083b23 req-7e02e5c4-4a16-4383-afa8-03f19ac30648 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1165063 Nov 18 21:05:33.956718 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b4decdef-8361-4a41-900e-d44500083b23 req-e0c47bd6-8ddf-42b3-81d0-b712efe55987 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1574085 Nov 18 21:05:34.052796 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Router 141c8833-0a33-4ff3-bb35-3a9703fba940 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:05:34.198527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:05:34.209172 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-d72e7118-9dc0-4293-8ed3-bc6d9d42965e admin admin] 10.222.0.61 "PUT /v2.0/routers/141c8833-0a33-4ff3-bb35-3a9703fba940/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.4514475 Nov 18 21:05:34.209172 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39204) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:34.212882 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] Sync routers for ids ['141c8833-0a33-4ff3-bb35-3a9703fba940'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:05:34.224548 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] Routers {'141c8833-0a33-4ff3-bb35-3a9703fba940'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:05:34.225247 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:05:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['141c8833-0a33-4ff3-bb35-3a9703fba940'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:34.335585 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks [] for router, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:34.344654 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] Set router 141c8833-0a33-4ff3-bb35-3a9703fba940 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:05:34.473903 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:34.557390 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Deleting port 0ab796a4-5d10-4a4d-a1a8-8689972297d7 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:05:34.557390 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:34.563926 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75'}], 'enable_snat': True}, 'gw_port_id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:05:33Z', 'revision_number': 5, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port': {'id': '0ab796a4-5d10-4a4d-a1a8-8689972297d7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:94:9b:b1', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'device_owner': 'network:router_gateway', 'standard_attr_id': 72, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.75', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:39Z', 'updated_at': '2021-11-18T21:00:49Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:34.610472 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] Checking router: 141c8833-0a33-4ff3-bb35-3a9703fba940 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:05:34.625508 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] Routers {'141c8833-0a33-4ff3-bb35-3a9703fba940'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:05:34.630886 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:05:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['141c8833-0a33-4ff3-bb35-3a9703fba940'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:34.646975 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-84eeaf3d-7be5-45d3-8c8a-88ab405b5678 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:34.696505 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] For port 0ab796a4-5d10-4a4d-a1a8-8689972297d7, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0ab796a4-5d10-4a4d-a1a8-8689972297d7,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:34.697123 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:34.726762 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Calling delete_port for 0ab796a4-5d10-4a4d-a1a8-8689972297d7 owned by network:router_gateway {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:05:34.772673 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] Set router 141c8833-0a33-4ff3-bb35-3a9703fba940 gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:05:34.837806 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 618d8033-6b64-42ec-805f-1007401fc720 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:34.845912 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:05:34Z', 'revision_number': 6, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:34.880337 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 618d8033-6b64-42ec-805f-1007401fc720 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:34.881418 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 618d8033-6b64-42ec-805f-1007401fc720 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:34.888486 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ff4109fe-5554-48ce-85aa-a85cd7e3fc22 None None] The sync data for ids ['141c8833-0a33-4ff3-bb35-3a9703fba940'] in dv-cinder-799871-8-iscsi is: [{'id': '141c8833-0a33-4ff3-bb35-3a9703fba940', 'name': 'tempest-ServerRescueNegativeTestJSON-1847422265-router', 'tenant_id': '5c11bd4ad5214d279c477c233d05b6d3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:05:34Z', 'revision_number': 6, 'project_id': '5c11bd4ad5214d279c477c233d05b6d3', 'gw_port_host': None}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:05:35.022941 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.060371 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Pushing event deleted for resources: {'Port': ['ID=0ab796a4-5d10-4a4d-a1a8-8689972297d7,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:35.130739 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.146079 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-25e8fff8-5b53-480f-9c1e-9ca2408b2a97 req-88c46e1b-8fe7-49b1-90f5-94132802806c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:35.148619 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-25e8fff8-5b53-480f-9c1e-9ca2408b2a97 req-88c46e1b-8fe7-49b1-90f5-94132802806c tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0856750 Nov 18 21:05:35.288367 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-25e8fff8-5b53-480f-9c1e-9ca2408b2a97 req-20e183f0-070e-4be2-a1ae-b589e82e2f10 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1219125 Nov 18 21:05:35.294277 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.299091 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.414906 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.415473 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 141c8833-0a33-4ff3-bb35-3a9703fba940 {{(pid=102670) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:05:35.423838 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.425141 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-239a9ddf-e8d1-456b-a31c-9587027f1992 admin admin] 10.222.0.61 "DELETE /v2.0/routers/141c8833-0a33-4ff3-bb35-3a9703fba940 HTTP/1.1" status: 204 len: 168 time: 1.2151611 Nov 18 21:05:35.428781 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39216) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:35.485420 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Deleting subnet ecbb94e2-6852-471b-9339-07ed4834cbe7 {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:05:35.488868 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.545493 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.593958 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.651595 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.697179 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ecbb94e2-6852-471b-9339-07ed4834cbe7,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:35.699137 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.703444 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-55136866-282b-4402-b427-460bf5c2f596 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/ecbb94e2-6852-471b-9339-07ed4834cbe7 HTTP/1.1" status: 204 len: 168 time: 0.2729850 Nov 18 21:05:35.706329 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39222) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:35.810616 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.867557 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3cefd565-3646-40ee-9393-8f0787133ebb no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:35.894379 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 3cefd565-3646-40ee-9393-8f0787133ebb {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:35.895106 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3cefd565-3646-40ee-9393-8f0787133ebb not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:35.896141 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0ab796a4-5d10-4a4d-a1a8-8689972297d7 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:05:35.924729 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 0ab796a4-5d10-4a4d-a1a8-8689972297d7 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:05:35.925241 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0ab796a4-5d10-4a4d-a1a8-8689972297d7 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:05:35.943022 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:35.989277 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5973daa9-793c-40f5-972b-25507ee923a3']}} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:36.001718 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '346175a8-8f3b-4db0-acce-2b22e5308fa2') {'for_net_delete': True} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:36.002051 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '346175a8-8f3b-4db0-acce-2b22e5308fa2') {} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:36.013212 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.023576 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5774120'] for segment, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.045868 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.053583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Releasing vlan 640 on physical network physnet1 to pool {{(pid=102669) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:05:36.054191 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5320355'] for segment, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: Traceback (most recent call last): Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: timer() Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: cb(*args, **kw) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: return func(*args, **kwargs) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: self._notify() Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: self.callback(batched_events) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: event.method(event) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: return f(self, *a, **k) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._get(url).json() Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: return self.request(url, 'GET', **kwargs) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:05:36.056562 dv-cinder-799871-8-iscsi neutron-server[102669]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:05:36.124132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.143176 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Pushing event deleted for resources: {'Network': ['ID=5973daa9-793c-40f5-972b-25507ee923a3,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:36.145350 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.148915 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cdc695e0-dd72-4cbd-a67e-111c2d2f288c admin admin] 10.222.0.61 "DELETE /v2.0/networks/5973daa9-793c-40f5-972b-25507ee923a3 HTTP/1.1" status: 204 len: 168 time: 0.4413431 Nov 18 21:05:36.365246 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39234) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:36.489335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f1878fd-33c2-4309-b913-0029b47db586 req-6c803f2d-308b-4fde-89d4-1d771b83ce47 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:36.491051 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8f1878fd-33c2-4309-b913-0029b47db586 req-6c803f2d-308b-4fde-89d4-1d771b83ce47 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0644505 Nov 18 21:05:36.566291 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8f1878fd-33c2-4309-b913-0029b47db586 req-c090d6cc-ff86-4f3e-93b8-83c635bea9bd tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0690577 Nov 18 21:05:36.686195 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7f805a3e-c5db-4008-85cc-235e8c02eec7 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=5c11bd4ad5214d279c477c233d05b6d3&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3181317 Nov 18 21:05:36.690193 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39240) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:36.744728 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-630aa7b2-82bf-4183-ac50-ecaa196bb822 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.771097 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-630aa7b2-82bf-4183-ac50-ecaa196bb822 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.831311 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-630aa7b2-82bf-4183-ac50-ecaa196bb822 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.836436 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-630aa7b2-82bf-4183-ac50-ecaa196bb822 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:36.837707 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-630aa7b2-82bf-4183-ac50-ecaa196bb822 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/827e81d5-c5d1-4ee0-9f96-e195ef77902b HTTP/1.1" status: 204 len: 168 time: 0.1463053 Nov 18 21:05:36.848969 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-630aa7b2-82bf-4183-ac50-ecaa196bb822 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=827e81d5-c5d1-4ee0-9f96-e195ef77902b,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:37.471781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:37.705383 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39276) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:37.743282 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e39aeabf-4336-439b-9605-e203a3953db8 req-abaeb29b-97e3-468a-84b5-c69908af9de1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:37.744559 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e39aeabf-4336-439b-9605-e203a3953db8 req-abaeb29b-97e3-468a-84b5-c69908af9de1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0774927 Nov 18 21:05:37.845520 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e39aeabf-4336-439b-9605-e203a3953db8 req-eb0073bc-a54a-4cee-af72-1e332da4da93 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0913613 Nov 18 21:05:37.894526 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-191819174-network', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:37.934987 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Made reservation on behalf of c3bcf8e1cce94073aab8b79c5acafab3 for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:37.938534 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:37.948340 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.071736 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.077769 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.099941 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39290) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:38.114722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 635} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:05:38.131752 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c94781e2-0893-440f-b61d-1258197fd8c5,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:38.141250 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.141823 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Added segment efaeced5-9640-4392-842a-6c363cdec428 of type vlan for network b99d0e78-8d9d-4599-8cb9-01e271840ab6 Nov 18 21:05:38.213785 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.249280 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e39379a5-901a-4283-b10c-cabfb10f0ac6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.249616 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.257327 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.258393 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:38.259080 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.317767 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 883 time: 0.6108518 Nov 18 21:05:38.323536 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39298) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:38.330397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Request body: {'subnet': {'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-191819174-subnet', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:38.332636 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d9bcf73-e40f-4538-8fc2-92ca338703ba admin admin] Pushing event updated for resources: {'Network': ['ID=b99d0e78-8d9d-4599-8cb9-01e271840ab6,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:38.344192 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:05:38.367284 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e39379a5-901a-4283-b10c-cabfb10f0ac6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.371892 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e39379a5-901a-4283-b10c-cabfb10f0ac6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.384137 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Made reservation on behalf of c3bcf8e1cce94073aab8b79c5acafab3 for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:38.387009 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.462757 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e39379a5-901a-4283-b10c-cabfb10f0ac6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6601d409-78bb-4be5-af59-607d4b606ce6,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:38.469584 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e39379a5-901a-4283-b10c-cabfb10f0ac6 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=942f3214972d4e62b6e618495d449ff7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3679535 Nov 18 21:05:38.473836 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39300) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:38.617068 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.680995 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Pushing event updated for resources: {'Subnet': ['ID=fff76f80-c70a-413a-aadb-600c993bbf6b,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:38.694889 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Checking segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:38.695452 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Network hostable DHCP agents. Network: b99d0e78-8d9d-4599-8cb9-01e271840ab6, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:05:38.722320 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:05:38.735255 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, b99d0e78-8d9d-4599-8cb9-01e271840ab6) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:38.742896 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:38.742896 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.751291 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-021e189e-82a7-4667-b5f4-86056e7eb4c1 None None] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:05:38.768154 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-426c77a2-a756-411d-8aa0-8e39a8990b57 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 0.4431489 Nov 18 21:05:38.770930 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39302) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:38.776544 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:38.819294 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.821815 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.830606 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34edfacb-13b8-488b-b105-87f9a79861ec admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.870501 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34edfacb-13b8-488b-b105-87f9a79861ec admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.901020 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.970227 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:05:38.971405 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.973901 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34edfacb-13b8-488b-b105-87f9a79861ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.978269 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34edfacb-13b8-488b-b105-87f9a79861ec admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:38.987030 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-34edfacb-13b8-488b-b105-87f9a79861ec admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6601d409-78bb-4be5-af59-607d4b606ce6 HTTP/1.1" status: 204 len: 168 time: 0.5101562 Nov 18 21:05:39.013964 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34edfacb-13b8-488b-b105-87f9a79861ec admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6601d409-78bb-4be5-af59-607d4b606ce6,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:39.124247 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.189487 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-948fb243-df9b-4e68-a9e7-8f55177b67ca req-03e71923-b8fb-4a9b-bcd0-f1f5f7ff9616 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:39.192324 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-948fb243-df9b-4e68-a9e7-8f55177b67ca req-03e71923-b8fb-4a9b-bcd0-f1f5f7ff9616 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.2043841 Nov 18 21:05:39.333616 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Allocated IP 172.20.0.2 (b99d0e78-8d9d-4599-8cb9-01e271840ab6/fff76f80-c70a-413a-aadb-600c993bbf6b/4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:05:39.368454 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-948fb243-df9b-4e68-a9e7-8f55177b67ca req-a0d9290e-c903-47c6-9e56-1603632f5f86 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1627445 Nov 18 21:05:39.484198 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.511585 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.578574 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.589294 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.635932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:05:39.642624 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:39.646282 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:05:39.667777 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Allocated IP 172.27.3.47 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/2d7610ac-5a58-409b-9013-dd34ef29c6c6) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:05:39.693448 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Pushing event updated for resources: {'Port': ['ID=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:39.726404 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Attempting to bind port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:05:39.726874 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Attempting to bind port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:05:39.727482 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Attempting to bind port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:05:39.730663 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.731120 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.731372 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.731933 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.732867 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.732867 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.733293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.733592 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.733927 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.734257 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.734587 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.734938 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:39.741880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 5, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:05:39.742252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Checking segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:39.742648 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.743019 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Bound using segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:05:39.743488 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Bound port: 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:05:39.743867 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.844372 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] For port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:05:39.851868 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] For port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:05:39.860532 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.868365 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.930595 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:39.981812 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a05ee26f-31b8-442b-b209-d98c16ac8fee None None] Pushing event updated for resources: {'Port': ['ID=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:40.005493 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:05:40.006915 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Pushing event updated for resources: {'Port': ['ID=2d7610ac-5a58-409b-9013-dd34ef29c6c6,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:40.011884 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:40.016764 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:05:40.342429 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39338) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:40.561841 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-314271086-network', 'tenant_id': '7dcc38730e6a4a3d878e2a9a4ff57044'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:40.601831 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Made reservation on behalf of 7dcc38730e6a4a3d878e2a9a4ff57044 for: {'network': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:40.604374 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:40.616854 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:40.759517 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:40.760782 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39350) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:40.775496 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:40.825962 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 620} {{(pid=102670) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:05:40.870453 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=63929d0b-de14-42fa-8980-c511f5fab220,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:40.876901 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:40.884347 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:40.885234 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.segments_db [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Added segment c883b6d4-d4d1-4621-ba07-6ac65b871caa of type vlan for network b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54 Nov 18 21:05:40.908150 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10e5664c-94c1-478d-9ba6-711336b4c480 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.024470 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.086233 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.087492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:41.088126 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.115635 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54e4e7d7-5547-477d-b580-bb119804d68d req-ec271a62-0098-4bb2-8c73-dd36da6d1c18 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:41.117269 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-54e4e7d7-5547-477d-b580-bb119804d68d req-ec271a62-0098-4bb2-8c73-dd36da6d1c18 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.4917514 Nov 18 21:05:41.171576 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 0.8244371 Nov 18 21:05:41.172696 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39354) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:41.179265 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Request body: {'subnet': {'network_id': 'b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-314271086-subnet', 'tenant_id': '7dcc38730e6a4a3d878e2a9a4ff57044', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:41.183169 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10e5664c-94c1-478d-9ba6-711336b4c480 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.195120 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-10e5664c-94c1-478d-9ba6-711336b4c480 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.210835 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb871c31-8d77-4cc1-8b40-061811440245 admin admin] Pushing event updated for resources: {'Network': ['ID=b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:41.243008 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:05:41.248904 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10e5664c-94c1-478d-9ba6-711336b4c480 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2feb0793-75ee-4c6a-8729-5e040b9c14eb,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:41.256592 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-10e5664c-94c1-478d-9ba6-711336b4c480 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a9ebf8d422ac4d07af18312df2e97b8f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4915257 Nov 18 21:05:41.259094 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39356) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:41.274880 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.281960 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Made reservation on behalf of 7dcc38730e6a4a3d878e2a9a4ff57044 for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:41.284397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.295963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-54e4e7d7-5547-477d-b580-bb119804d68d req-27de5141-3652-49aa-b7d5-cc362c39066e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1688740 Nov 18 21:05:41.361103 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c171e909-1a5a-47c4-bf3c-3677d0d2e8a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.385663 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c171e909-1a5a-47c4-bf3c-3677d0d2e8a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.404789 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-68022329-ae4d-4eac-927b-efaede5ab95d None None] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:05:41.466350 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c171e909-1a5a-47c4-bf3c-3677d0d2e8a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.472265 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c171e909-1a5a-47c4-bf3c-3677d0d2e8a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.473972 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c171e909-1a5a-47c4-bf3c-3677d0d2e8a8 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2feb0793-75ee-4c6a-8729-5e040b9c14eb HTTP/1.1" status: 204 len: 168 time: 0.2138345 Nov 18 21:05:41.488811 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c171e909-1a5a-47c4-bf3c-3677d0d2e8a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2feb0793-75ee-4c6a-8729-5e040b9c14eb,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:41.492861 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-1d74ad8e-b466-46a8-ab13-775a6e2bce94 None None] Provisioning complete for port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:41.493714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1d74ad8e-b466-46a8-ab13-775a6e2bce94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.577557 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102669) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:05:41.679124 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.717768 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1d74ad8e-b466-46a8-ab13-775a6e2bce94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.788156 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Pushing event updated for resources: {'Subnet': ['ID=b3c4c740-3804-4706-8391-60cdbb205fda,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:41.802956 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-1d74ad8e-b466-46a8-ab13-775a6e2bce94 None None] For port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:41.811029 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1d74ad8e-b466-46a8-ab13-775a6e2bce94 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.853289 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Checking segment: {'id': 'c883b6d4-d4d1-4621-ba07-6ac65b871caa', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 620, 'network_id': 'b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:41.854058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Network hostable DHCP agents. Network: b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:05:41.858863 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:05:41.893083 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.895653 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a880a981-a518-4f1d-ac82-f1bf1e823397 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 921 time: 3.1237044 Nov 18 21:05:41.899203 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39362) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:41.899832 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Network b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:05:41.903629 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:05:41.915473 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:41.923907 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:41.927303 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:41.950656 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b0cf229b-6887-4165-9f84-b2ac53f2e2f0 None None] Network b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:05:41.954029 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:05:41.957227 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b0d00949-47a0-49f9-95fe-6b9b5c28b37f admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 0.7813835 Nov 18 21:05:41.983535 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:05:41.984533 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:05:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:42.226431 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d74ad8e-b466-46a8-ab13-775a6e2bce94 None None] Pushing event updated for resources: {'Port': ['ID=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:42.317710 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-ab863621-9865-413d-b58e-203cc2ce411a None None] Provisioning complete for port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:42.318451 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ab863621-9865-413d-b58e-203cc2ce411a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:42.424488 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:05:42.507387 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:42.507770 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:42.510855 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-abad0783-0159-418c-b9d8-8a2418412b47 None None] Network b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:05:42.526225 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd8c4f32-6584-4fb5-9a6e-581da343324f req-818f1340-ab6b-4f0f-9cde-a5e27941b122 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:42.527954 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd8c4f32-6584-4fb5-9a6e-581da343324f req-818f1340-ab6b-4f0f-9cde-a5e27941b122 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1069179 Nov 18 21:05:42.564233 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:42.685702 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bd8c4f32-6584-4fb5-9a6e-581da343324f req-6ab09063-e6a9-4d47-9dca-ddcdeb93e7b0 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1435301 Nov 18 21:05:42.803841 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39382) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:42.814277 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-2051026498-network', 'tenant_id': '21766fcbb4e24655a40428bde1ccf8f1'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:42.841529 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Allocated IP 172.20.0.1 (b99d0e78-8d9d-4599-8cb9-01e271840ab6/fff76f80-c70a-413a-aadb-600c993bbf6b/55f31c46-aa8c-4f73-a58c-bf8a9c401ffd) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:05:42.870724 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Made reservation on behalf of 21766fcbb4e24655a40428bde1ccf8f1 for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:42.872514 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:42.892830 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:42.934180 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:40Z', 'revision_number': 3, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:42.964674 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:05:42.965279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Updating router 026270c0-4694-40c1-b821-e8e67ee0d2c7 port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:05:43.002124 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.020458 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.023726 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.025415 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.052332 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 610} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:05:43.075382 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bd7bbc70-4646-4261-8536-1094b58b4fdc,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:43.080163 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.082511 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.082858 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Added segment 9f1a86ac-e6d8-43a4-bbb2-fdd164a3dad9 of type vlan for network 700b1da5-f69d-4001-bb89-aa48f627a48c Nov 18 21:05:43.139465 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:05:43.144348 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.144602 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:43.148001 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:05:43.178477 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Pushing event updated for resources: {'Port': ['ID=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:43.192510 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.194689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:43.196569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.209544 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.315085 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 0.5041368 Nov 18 21:05:43.315465 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39386) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:43.328612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Request body: {'subnet': {'network_id': '700b1da5-f69d-4001-bb89-aa48f627a48c', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-2051026498-subnet', 'tenant_id': '21766fcbb4e24655a40428bde1ccf8f1', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:43.334020 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0556bfba-d33b-48e9-b45c-fd50677c514d admin admin] Pushing event updated for resources: {'Network': ['ID=700b1da5-f69d-4001-bb89-aa48f627a48c,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:43.352455 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 700b1da5-f69d-4001-bb89-aa48f627a48c details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:05:43.391363 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Made reservation on behalf of 21766fcbb4e24655a40428bde1ccf8f1 for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:43.396647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.476295 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.588151 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.603747 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.610671 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-19a07c10-b5ae-40f8-b04f-4d6229f74518 None None] Provisioning complete for port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:43.611138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-19a07c10-b5ae-40f8-b04f-4d6229f74518 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.696461 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.732347 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.742605 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.760437 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72143ee7-e907-4ae2-b569-751fc871281e None None] Pushing event updated for resources: {'Port': ['ID=2d7610ac-5a58-409b-9013-dd34ef29c6c6,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:43.792064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Attempting to bind port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:05:43.792534 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Attempting to bind port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:05:43.792903 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Attempting to bind port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:05:43.810809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 5, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:05:43.810809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:43.810809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.810809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:05:43.815232 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Bound port: 2d7610ac-5a58-409b-9013-dd34ef29c6c6, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:05:43.824242 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.833077 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-19a07c10-b5ae-40f8-b04f-4d6229f74518 None None] Port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:05:43.870776 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Pushing event updated for resources: {'Port': ['ID=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:43.874457 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:43.881483 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:05:43.905612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Pushing event updated for resources: {'Subnet': ['ID=5b6e8e83-7e0e-4795-a368-0743caf725e9,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:43.924523 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Checking segment: {'id': '9f1a86ac-e6d8-43a4-bbb2-fdd164a3dad9', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 610, 'network_id': '700b1da5-f69d-4001-bb89-aa48f627a48c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:43.924976 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Network hostable DHCP agents. Network: 700b1da5-f69d-4001-bb89-aa48f627a48c, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:05:43.941954 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27862f3d-c450-4dc4-a181-2fcfb4772b37 req-90433d44-e16c-49e8-a39f-e2091daa8e28 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:43.943985 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-27862f3d-c450-4dc4-a181-2fcfb4772b37 req-90433d44-e16c-49e8-a39f-e2091daa8e28 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1164763 Nov 18 21:05:43.983630 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Network 700b1da5-f69d-4001-bb89-aa48f627a48c is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:05:43.990587 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] For port 2d7610ac-5a58-409b-9013-dd34ef29c6c6, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:05:43.999397 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] For port 2d7610ac-5a58-409b-9013-dd34ef29c6c6, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=2d7610ac-5a58-409b-9013-dd34ef29c6c6,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:05:44.004688 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 700b1da5-f69d-4001-bb89-aa48f627a48c) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:44.009682 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.010236 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:44.014046 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.020521 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:05:44.023621 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:44.027065 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7b8cbf5-0e58-4407-bf1a-69cf405adf0e None None] Network 700b1da5-f69d-4001-bb89-aa48f627a48c requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:05:44.109637 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-27862f3d-c450-4dc4-a181-2fcfb4772b37 req-bbf3b490-7200-420a-b5fb-44fe7671e493 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1456912 Nov 18 21:05:44.125016 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:44.125239 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.133473 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-85755023-840e-44cb-ae63-1052718e7037 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 0.8127558 Nov 18 21:05:44.231535 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72143ee7-e907-4ae2-b569-751fc871281e None None] Pushing event updated for resources: {'Port': ['ID=2d7610ac-5a58-409b-9013-dd34ef29c6c6,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:44.237896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:05:44.272251 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:05:44.273095 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:05:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:44.325092 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39394) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:44.411628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Deleting subnet b3c4c740-3804-4706-8391-60cdbb205fda {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:05:44.416703 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.423358 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:05:44.429411 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-baea4b17-23f4-48fc-8a9c-c193a9adbffe admin admin] 10.222.0.61 "PUT /v2.0/routers/026270c0-4694-40c1-b821-e8e67ee0d2c7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5287318 Nov 18 21:05:44.469905 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.544643 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.554007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-07756b36-7a0d-46ac-b3fb-b783fa4e3883 None None] Provisioning complete for port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:44.554664 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-07756b36-7a0d-46ac-b3fb-b783fa4e3883 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.624505 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.657893 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b3c4c740-3804-4706-8391-60cdbb205fda,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:44.671904 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.675968 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-abe5a951-7013-4941-bf0b-f73494c6bd9f admin admin] 10.222.0.61 "DELETE /v2.0/subnets/b3c4c740-3804-4706-8391-60cdbb205fda HTTP/1.1" status: 204 len: 168 time: 0.3491664 Nov 18 21:05:44.678485 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39402) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:44.759177 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:05:44.762847 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-07756b36-7a0d-46ac-b3fb-b783fa4e3883 None None] Port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:05:44.784461 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.801535 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30cd3667-cc65-456e-991f-594c368f0206 None None] Network 700b1da5-f69d-4001-bb89-aa48f627a48c requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:05:44.896811 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.921440 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54']}} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:44.942802 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c883b6d4-d4d1-4621-ba07-6ac65b871caa') {'for_net_delete': True} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:44.943149 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c883b6d4-d4d1-4621-ba07-6ac65b871caa') {} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:44.963534 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5774120'] for segment, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.984964 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:44.996465 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Releasing vlan 620 on physical network physnet1 to pool {{(pid=102669) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:05:44.996938 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5320355'] for segment, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: Traceback (most recent call last): Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: timer() Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: cb(*args, **kw) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: return func(*args, **kwargs) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: self._notify() Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: self.callback(batched_events) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: event.method(event) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: return f(self, *a, **k) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._get(url).json() Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: return self.request(url, 'GET', **kwargs) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:05:45.000503 dv-cinder-799871-8-iscsi neutron-server[102669]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:05:45.083413 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.095212 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.104746 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39410) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:45.105961 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] 10.222.0.61 "DELETE /v2.0/networks/b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54 HTTP/1.1" status: 204 len: 168 time: 0.4260938 Nov 18 21:05:45.147925 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-844a2c80-05e2-492a-b2e6-6232fab1aefa admin admin] Pushing event deleted for resources: {'Network': ['ID=b4cc7396-bb15-4e22-b8ff-c7cfa7db6f54,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:45.160095 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 2, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:45.185680 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39416) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:45.193686 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'security_group': {'name': 'tempest-securitygroup--809827216', 'description': 'tempest-description--594712339'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:45.202990 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8f904fe8-673f-4993-8d5f-78b64568cdd2 None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 2, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:05:45.238260 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Deleting subnet 5b6e8e83-7e0e-4795-a368-0743caf725e9 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:05:45.242332 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.252183 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.290609 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.316904 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f20ebf0f-3a75-4ecd-93fb-10560ef419c4 req-22846fac-d6de-4039-9b23-9a6623f79a4b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:45.318542 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f20ebf0f-3a75-4ecd-93fb-10560ef419c4 req-22846fac-d6de-4039-9b23-9a6623f79a4b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0811572 Nov 18 21:05:45.366499 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.415723 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.426126 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.455922 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.499273 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.499834 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f20ebf0f-3a75-4ecd-93fb-10560ef419c4 req-a55b8f1c-58ba-4253-8985-3accdc6bbfab tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1693971 Nov 18 21:05:45.502833 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/5b6e8e83-7e0e-4795-a368-0743caf725e9 HTTP/1.1" status: 204 len: 168 time: 0.3946087 Nov 18 21:05:45.507597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39418) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:45.516739 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-290a33df-0120-43a9-a1df-3d833acae2c0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5b6e8e83-7e0e-4795-a368-0743caf725e9,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:45.534601 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.537132 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1795 time: 0.3501136 Nov 18 21:05:45.542451 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39420) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:45.554779 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'security_group_rule': {'security_group_id': '4b2913ed-86b0-4587-843f-c453f93f79f4', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:45.562385 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe53fc29-1a30-4275-bec3-79c1b6b375f0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'SecurityGroup': ['ID=4b2913ed-86b0-4587-843f-c453f93f79f4,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:45.594887 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.611775 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.682317 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.688522 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.708807 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=66e9a145-e080-4f1a-a0b2-d715988546eb,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:45.709919 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.724855 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.726818 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7e93c6ab-f002-447d-8d91-5e4405af6a9b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1756358 Nov 18 21:05:45.729595 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39422) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:45.738484 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'security_group_rule': {'security_group_id': '4b2913ed-86b0-4587-843f-c453f93f79f4', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:45.747808 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['700b1da5-f69d-4001-bb89-aa48f627a48c']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:45.758531 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9f1a86ac-e6d8-43a4-bbb2-fdd164a3dad9') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:45.758858 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9f1a86ac-e6d8-43a4-bbb2-fdd164a3dad9') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:45.770162 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.772774 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.786721 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.793915 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Releasing vlan 610 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:05:45.794398 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:05:45.797250 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:05:45.849153 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.853956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.858304 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.874084 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=fc6dc61c-22bc-47ca-ac83-86d9cbf16e2e,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:45.876240 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.880419 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] 10.222.0.61 "DELETE /v2.0/networks/700b1da5-f69d-4001-bb89-aa48f627a48c HTTP/1.1" status: 204 len: 168 time: 0.3706512 Nov 18 21:05:45.885672 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7709a357-4404-4447-a9a4-a82ced582b83 admin admin] Pushing event deleted for resources: {'Network': ['ID=700b1da5-f69d-4001-bb89-aa48f627a48c,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:45.888959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:45.893715 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-ddd3254c-c2fa-403e-86b6-9689897cb376 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1602623 Nov 18 21:05:45.894753 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39426) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:45.900474 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:45.927824 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.083381 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.120654 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39428) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:46.168544 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0d4e254b-767f-490a-91b5-2f6d80fdba96 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=7dcc38730e6a4a3d878e2a9a4ff57044&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0457051 Nov 18 21:05:46.172339 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39430) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:46.209881 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Allocated IP 172.27.3.31 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/52528f0f-114f-40ae-8853-f40fc888eeb9) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:05:46.236298 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-406ad063-8084-419e-b3c1-4c96df98aa78 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.270575 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-406ad063-8084-419e-b3c1-4c96df98aa78 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.341928 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-406ad063-8084-419e-b3c1-4c96df98aa78 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.346789 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-406ad063-8084-419e-b3c1-4c96df98aa78 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.347975 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.348698 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-406ad063-8084-419e-b3c1-4c96df98aa78 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/63929d0b-de14-42fa-8980-c511f5fab220 HTTP/1.1" status: 204 len: 168 time: 0.1738739 Nov 18 21:05:46.364456 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406ad063-8084-419e-b3c1-4c96df98aa78 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=63929d0b-de14-42fa-8980-c511f5fab220,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:46.411384 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.454295 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:05:46.457518 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:46.461119 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:05:46.467182 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'Port': ['ID=52528f0f-114f-40ae-8853-f40fc888eeb9,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:46.576767 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.627335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.692809 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1d0c4be-3005-4c10-9827-796f6337eb15 req-73443066-185d-46ff-8251-51244ce52cc3 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:46.709438 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e1d0c4be-3005-4c10-9827-796f6337eb15 req-73443066-185d-46ff-8251-51244ce52cc3 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0677788 Nov 18 21:05:46.795288 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e1d0c4be-3005-4c10-9827-796f6337eb15 req-2bdc00ea-a3c1-4c3b-9782-72c514118786 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0846677 Nov 18 21:05:46.816438 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39440) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:46.894014 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.901217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:46.933702 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-6a868ae5-858f-4b76-bbfe-0ac2ffcd17e9 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=21766fcbb4e24655a40428bde1ccf8f1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1160953 Nov 18 21:05:46.936956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39442) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:47.026699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'Port': ['ID=52528f0f-114f-40ae-8853-f40fc888eeb9,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:47.043352 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:47.060709 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-681b521f-14d3-484a-81ea-b375acc11221 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:47.080492 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:47.081806 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f3275475-9946-418f-bbba-84d44a4ba2c9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.1859684 Nov 18 21:05:47.099189 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-681b521f-14d3-484a-81ea-b375acc11221 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:47.155643 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-681b521f-14d3-484a-81ea-b375acc11221 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:47.158700 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-681b521f-14d3-484a-81ea-b375acc11221 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:47.160017 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-681b521f-14d3-484a-81ea-b375acc11221 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/bd7bbc70-4646-4261-8536-1094b58b4fdc HTTP/1.1" status: 204 len: 168 time: 0.2221780 Nov 18 21:05:47.168528 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-681b521f-14d3-484a-81ea-b375acc11221 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bd7bbc70-4646-4261-8536-1094b58b4fdc,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:47.316767 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-bded0d49-b3c4-483e-b5c5-f25c0a054377 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--809827216&fields=id&tenant_id=c3bcf8e1cce94073aab8b79c5acafab3 HTTP/1.1" status: 200 len: 267 time: 0.0598195 Nov 18 21:05:47.444919 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-fbd0e846-396c-4e0b-887f-07b42880de4e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:47.446640 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-fbd0e846-396c-4e0b-887f-07b42880de4e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 810 time: 0.1277061 Nov 18 21:05:47.464683 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-30c66406-17d2-4725-bfca-4c4319aed293 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/quotas/c3bcf8e1cce94073aab8b79c5acafab3 HTTP/1.1" status: 200 len: 375 time: 0.0105782 Nov 18 21:05:47.522048 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-570f0166-4961-476f-a6ea-55b4ff7aefa1 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0497153 Nov 18 21:05:47.684061 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:05:47.695201 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:05:47.695707 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:05:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:47.805357 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-d1e39263-8bf0-4706-9a4e-fb132db164ba service neutron] 10.222.0.61 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2706652 Nov 18 21:05:47.819229 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:05:47.851583 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 2d7610ac-5a58-409b-9013-dd34ef29c6c6 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:05:47.945145 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-e4e1e288-4de4-4e86-a5ca-dec35d34033d service neutron] 10.222.0.61 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1325636 Nov 18 21:05:47.961150 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59c23ea7-0a49-40f6-93cc-565a0561fb7e req-6f61ae8d-9009-4d23-b00b-275aa2fc9d50 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:47.968772 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-59c23ea7-0a49-40f6-93cc-565a0561fb7e req-6f61ae8d-9009-4d23-b00b-275aa2fc9d50 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0688715 Nov 18 21:05:47.972858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:47.973232 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:48.118958 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:48.127092 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-59c23ea7-0a49-40f6-93cc-565a0561fb7e req-0c5f586d-ac13-4b0c-a4ff-6fbfe39bcbae tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1552663 Nov 18 21:05:48.145360 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:05:48.156696 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b3dfcbc-e09d-4624-8731-cfb38083880e req-45e6fe3c-33e9-4742-afef-ee4e7b7f50aa tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.0470061 Nov 18 21:05:48.162474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 2d7610ac-5a58-409b-9013-dd34ef29c6c6, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=2d7610ac-5a58-409b-9013-dd34ef29c6c6,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:48.172218 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:48.241086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=2d7610ac-5a58-409b-9013-dd34ef29c6c6,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:48.330623 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 2, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:48.365017 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:05:48.365376 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Updating router 026270c0-4694-40c1-b821-e8e67ee0d2c7 port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:05:48.402151 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:48.834651 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:48.843741 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:48.963790 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Pushing event updated for resources: {'Port': ['ID=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:49.001929 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.002685 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.003305 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.003809 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.004322 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.004845 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.005485 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.005972 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.006472 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.006955 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.007452 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.007929 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:05:49.071169 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Attempting to bind port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:05:49.072013 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Attempting to bind port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:05:49.072637 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Attempting to bind port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:05:49.087960 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 5, 38), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:05:49.088782 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Checking segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:49.089261 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.089708 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Bound using segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:05:49.090560 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Bound port: 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:05:49.091719 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.194407 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] For port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:05:49.201164 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] For port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:05:49.214887 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.398505 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d054b3ef-3625-4d46-9aae-a5f4d34ed925 req-1065da3b-f5b0-43ce-9d72-bd109899f21d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.0946388 Nov 18 21:05:49.405304 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-0aee613a-2b3f-4530-a5aa-d99209f5d31e None None] Provisioning complete for port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:49.407972 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0aee613a-2b3f-4530-a5aa-d99209f5d31e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.442081 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:05:49.442699 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:05:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:49.461844 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.519518 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c1d02f1-9503-49b2-aba4-42082f46d76b req-56e9eadb-e1e3-488d-8deb-f6cba11c85e9 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:49.531222 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2c1d02f1-9503-49b2-aba4-42082f46d76b req-56e9eadb-e1e3-488d-8deb-f6cba11c85e9 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.1908903 Nov 18 21:05:49.691804 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:05:49.731373 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2c1d02f1-9503-49b2-aba4-42082f46d76b req-918781eb-a60b-481d-838e-492003fefb2a tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.1990705 Nov 18 21:05:49.736336 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0aee613a-2b3f-4530-a5aa-d99209f5d31e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.861196 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-0aee613a-2b3f-4530-a5aa-d99209f5d31e None None] For port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:05:49.866942 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0aee613a-2b3f-4530-a5aa-d99209f5d31e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:49.910119 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b0a40b7-2e3f-4b63-85ed-b850f4088cda None None] Pushing event updated for resources: {'Port': ['ID=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,revision_number=4']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:49.939176 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0aee613a-2b3f-4530-a5aa-d99209f5d31e None None] Pushing event updated for resources: {'Port': ['ID=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:49.969342 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 2d7610ac-5a58-409b-9013-dd34ef29c6c6 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:05:50.052383 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-dd01f1e4-81c4-4ad3-a05d-a991376e4fef None None] Provisioning complete for port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:50.053421 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dd01f1e4-81c4-4ad3-a05d-a991376e4fef None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.129725 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:50.130334 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.136893 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39542) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:50.191349 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:05:50.241941 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-412bf6bf-f10c-4bd4-992d-0f2a3118ca5b None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:05:50.299324 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3d2a96de-fa33-450e-be44-7028743ce3e4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.390663 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3d2a96de-fa33-450e-be44-7028743ce3e4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.395636 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3d2a96de-fa33-450e-be44-7028743ce3e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.438742 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3d2a96de-fa33-450e-be44-7028743ce3e4 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=759fdc0936044b2cbd04fa271f0cd3c8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2998407 Nov 18 21:05:50.439808 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3d2a96de-fa33-450e-be44-7028743ce3e4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e4d9216-1d6a-423a-8e0b-12244e1bad5e,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:50.441491 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39546) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:50.497530 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0959d212-54fe-48b2-868f-55cd2ab1f102 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.525069 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0959d212-54fe-48b2-868f-55cd2ab1f102 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.577937 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-855a4ad1-2757-4392-b45e-1278dc55ae38 req-22db83eb-2f94-42f7-be79-fe225f095a45 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.0280612 Nov 18 21:05:50.586345 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0959d212-54fe-48b2-868f-55cd2ab1f102 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.589352 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0959d212-54fe-48b2-868f-55cd2ab1f102 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.590658 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0959d212-54fe-48b2-868f-55cd2ab1f102 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/7e4d9216-1d6a-423a-8e0b-12244e1bad5e HTTP/1.1" status: 204 len: 168 time: 0.1479406 Nov 18 21:05:50.600238 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0959d212-54fe-48b2-868f-55cd2ab1f102 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e4d9216-1d6a-423a-8e0b-12244e1bad5e,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:50.881310 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa5db786-d778-4fbf-b68d-6ee1f0aa409f req-eff388b1-791e-4d1b-ab50-b7e59ad0f3be tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:50.882914 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-aa5db786-d778-4fbf-b68d-6ee1f0aa409f req-eff388b1-791e-4d1b-ab50-b7e59ad0f3be tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0730476 Nov 18 21:05:50.926477 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39558) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:50.943605 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7eec20e3-c2a7-4ebc-b538-49769d493693 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:50.971526 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-aa5db786-d778-4fbf-b68d-6ee1f0aa409f req-763bd965-43ff-4744-96dc-155003e1842e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&id=503edafc-04c7-45d2-b641-984e7e555400&fields=id&fields=name HTTP/1.1" status: 200 len: 380 time: 0.0773108 Nov 18 21:05:51.026496 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7eec20e3-c2a7-4ebc-b538-49769d493693 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:51.031743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7eec20e3-c2a7-4ebc-b538-49769d493693 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:51.069734 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7eec20e3-c2a7-4ebc-b538-49769d493693 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=02867e8e-41ad-43b4-a6d3-602fcd419237,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:51.073979 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7eec20e3-c2a7-4ebc-b538-49769d493693 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1225bc225ebd4ccf82d7895a07fafa25&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1462603 Nov 18 21:05:51.077512 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39562) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:05:51.130408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7b519cc0-041c-43aa-8272-d6f8f2271986 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:51.151651 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7b519cc0-041c-43aa-8272-d6f8f2271986 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:51.202108 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7b519cc0-041c-43aa-8272-d6f8f2271986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:51.204728 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7b519cc0-041c-43aa-8272-d6f8f2271986 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:51.205908 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7b519cc0-041c-43aa-8272-d6f8f2271986 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/02867e8e-41ad-43b4-a6d3-602fcd419237 HTTP/1.1" status: 204 len: 168 time: 0.1276319 Nov 18 21:05:51.214153 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b519cc0-041c-43aa-8272-d6f8f2271986 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=02867e8e-41ad-43b4-a6d3-602fcd419237,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:51.678619 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c27c3c62-71af-44a2-a1cf-e3252a8e1b39 req-e60b9222-7104-44da-9580-b288583bfd77 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.0287371 Nov 18 21:05:51.819712 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:05:51.881609 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:51.882243 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:52.777182 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0633e1ac-e91f-42d9-a406-7eb7f847969a req-8f332068-19b7-43dc-a945-063dd62d364d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.0280976 Nov 18 21:05:53.074472 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-d9809d81-4544-4eef-a362-17aeca234c77 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0582438 Nov 18 21:05:53.266265 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-3b035a4d-9c51-4ba6-9700-2b06845db2d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:53.268663 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-3b035a4d-9c51-4ba6-9700-2b06845db2d0 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 1100 time: 0.1438687 Nov 18 21:05:53.380877 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-12e42589-f01a-472f-a14d-0f15f85aa1c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:53.383131 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-12e42589-f01a-472f-a14d-0f15f85aa1c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 810 time: 0.2684009 Nov 18 21:05:53.464698 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-0f3676ba-e23e-4103-80c6-afc20badad31 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:53.466770 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-0f3676ba-e23e-4103-80c6-afc20badad31 service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.1675787 Nov 18 21:05:53.488433 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ecc2b92e-c2ee-4273-8df1-7fdfc1fff56e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c3bcf8e1cce94073aab8b79c5acafab3 HTTP/1.1" status: 200 len: 379 time: 0.0914760 Nov 18 21:05:53.522132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'port': {'device_id': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'admin_state_up': True, 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'security_groups': ['4b2913ed-86b0-4587-843f-c453f93f79f4']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:53.599612 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-f315446d-6711-46c3-84f2-2fed58b03b1c service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 200 len: 1002 time: 0.1243663 Nov 18 21:05:53.681640 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-34f20d9f-0025-499c-977b-d0f1d2937cf2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:53.683227 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-34f20d9f-0025-499c-977b-d0f1d2937cf2 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0714378 Nov 18 21:05:53.704160 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Made reservation on behalf of c3bcf8e1cce94073aab8b79c5acafab3 for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:05:53.708089 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:53.814902 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-35d2ad94-94b6-4a36-b7b5-0e70706c0132 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:53.816627 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-35d2ad94-94b6-4a36-b7b5-0e70706c0132 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1248045 Nov 18 21:05:54.247783 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d304869b-52a0-4c9a-9ce9-f6a3a559ba4e req-6215061c-a028-4ed8-bc77-2740767b4fc7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.3834963 Nov 18 21:05:54.295239 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Allocated IP 172.20.0.13 (b99d0e78-8d9d-4599-8cb9-01e271840ab6/fff76f80-c70a-413a-aadb-600c993bbf6b/9f8d85f0-073b-4d3b-b9e3-f904463e7647) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:05:54.365013 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-c61f6159-7d0a-40c5-a699-0ecce4c563f3 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5320694 Nov 18 21:05:54.574700 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:54.641463 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cf5df80d-9af8-4b6f-b89c-2178da3f9be2 req-e95f6bc5-4b7e-4b3f-8972-e7304ece86ef service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2637005 Nov 18 21:05:54.650386 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:54.702271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:05:54.705680 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:05:54.709380 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:05:54.734322 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'Port': ['ID=9f8d85f0-073b-4d3b-b9e3-f904463e7647,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:54.768777 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:54.769414 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:54.788118 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-ed32d7fe-5738-4d37-bfec-2ca6c3d2c48a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.2721276 Nov 18 21:05:54.939518 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-e0791da2-8e2c-4dca-9a62-d0f9bcf689ad None None] Provisioning complete for port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:05:54.940211 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e0791da2-8e2c-4dca-9a62-d0f9bcf689ad None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:54.978051 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-e0791da2-8e2c-4dca-9a62-d0f9bcf689ad None None] Port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:05:55.379073 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fc2b4f14-1af3-4df8-92cd-ed0a0d1459d2 req-55d2a0ff-a82b-4afa-b757-5722ea75b126 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:55.380617 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fc2b4f14-1af3-4df8-92cd-ed0a0d1459d2 req-55d2a0ff-a82b-4afa-b757-5722ea75b126 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 932 time: 0.0499694 Nov 18 21:05:55.429328 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fc2b4f14-1af3-4df8-92cd-ed0a0d1459d2 req-677aa235-6336-4546-94f8-870b27be6c16 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425858 Nov 18 21:05:56.548393 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-691ed71d-4093-4e6c-8fbd-705224a4c87c req-4ffffb16-a031-4108-a1de-7a7022437eac tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:56.550098 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-691ed71d-4093-4e6c-8fbd-705224a4c87c req-4ffffb16-a031-4108-a1de-7a7022437eac tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 932 time: 0.0517843 Nov 18 21:05:56.599318 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-691ed71d-4093-4e6c-8fbd-705224a4c87c req-540399ea-730c-426c-ac1d-c9c373349a9a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432482 Nov 18 21:05:57.396681 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Request body: {'port': {'device_id': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:05:57.463718 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:57.738174 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d27f970-4723-4ea7-9cb2-d9f9e0915b0d req-736f86c1-f6f0-459f-9f84-f8bacba0ba04 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:57.739973 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d27f970-4723-4ea7-9cb2-d9f9e0915b0d req-736f86c1-f6f0-459f-9f84-f8bacba0ba04 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 932 time: 0.0609498 Nov 18 21:05:57.808700 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7d27f970-4723-4ea7-9cb2-d9f9e0915b0d req-fe72f5dc-a4af-4dda-bb98-889648f56c95 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0602829 Nov 18 21:05:57.831424 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 9f8d85f0-073b-4d3b-b9e3-f904463e7647 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:05:57.849827 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:57.870413 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Transition to ACTIVE for port object 9f8d85f0-073b-4d3b-b9e3-f904463e7647 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:05:57.874269 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:57.924941 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Pushing event updated for resources: {'Port': ['ID=9f8d85f0-073b-4d3b-b9e3-f904463e7647,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:58.003418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Attempting to bind port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:05:58.003750 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Attempting to bind port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:05:58.004073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Attempting to bind port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:05:58.016946 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:05:58.017263 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Attempting to bind port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:05:58.022747 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 5, 49), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:05:58.023081 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Checking segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:05:58.023469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Bound using segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:05:58.023896 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Bound port: 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:05:58.024290 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:58.108478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] For port 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:05:58.112182 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] For port 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:05:58.117179 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:58.155397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.156653 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:05:58.158119 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] 10.222.0.62 "PUT /v2.0/ports/9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 1094 time: 0.7683489 Nov 18 21:05:58.158532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:05:58.160898 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-80780142-84aa-4613-8cff-c1aaefa0145d" -d '{"events": [{"name": "network-changed", "server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:05:58.191310 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a3847d6-a238-4bdf-ac1a-3cc72e1c2066 service neutron] Pushing event updated for resources: {'Port': ['ID=9f8d85f0-073b-4d3b-b9e3-f904463e7647,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:05:58.217986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:05:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-915c4181-34c8-45c0-a262-e26d1f08c337 x-openstack-request-id: req-915c4181-34c8-45c0-a262-e26d1f08c337 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:05:58.217986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:05:58.218376 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-915c4181-34c8-45c0-a262-e26d1f08c337 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:05:58.218662 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'status': 'completed', 'code': 200} Nov 18 21:05:58.288689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-c0e40bb4-3d7a-4ea5-bdb5-fa9a243f1ef4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.290348 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-c0e40bb4-3d7a-4ea5-bdb5-fa9a243f1ef4 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1097 time: 0.0517859 Nov 18 21:05:58.340657 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-213f3ff7-f60c-40cf-9856-c48e09a8ec63 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 217 time: 0.0380583 Nov 18 21:05:58.399777 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-6cb9c0ba-d103-48d5-bf13-1b08e6b6de13 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.401416 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-6cb9c0ba-d103-48d5-bf13-1b08e6b6de13 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0507443 Nov 18 21:05:58.477653 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-c7224d0a-0506-46c3-ada6-b84f982322d9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.479188 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-c7224d0a-0506-46c3-ada6-b84f982322d9 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0670366 Nov 18 21:05:58.586063 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-df5da359-84df-41a1-af60-d5efc88c1e91 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0971482 Nov 18 21:05:58.693005 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c0fdb851-314b-4cc5-9d14-519a7391f39b req-9e04650e-b37e-4ad0-a355-503e7ebc0928 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0957623 Nov 18 21:05:58.801353 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80780142-84aa-4613-8cff-c1aaefa0145d req-d5f2d0a4-ab19-44b2-a0b0-7aa8d7c0984f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.802954 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-d5f2d0a4-ab19-44b2-a0b0-7aa8d7c0984f service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1097 time: 0.0562696 Nov 18 21:05:58.940074 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80780142-84aa-4613-8cff-c1aaefa0145d req-8ef03a21-70ce-429f-9f4c-a07bd5dcf569 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.942462 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-8ef03a21-70ce-429f-9f4c-a07bd5dcf569 service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.1227098 Nov 18 21:05:58.950017 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45d90645-6299-45c4-be4b-e82abd225865 req-e7a792c9-a11e-464e-b339-224d8e4fb1d7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:58.955044 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-45d90645-6299-45c4-be4b-e82abd225865 req-e7a792c9-a11e-464e-b339-224d8e4fb1d7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 944 time: 0.0654271 Nov 18 21:05:59.011106 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-c004f285-72e4-4916-89f3-3a186aea5e5a service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 217 time: 0.0493443 Nov 18 21:05:59.031859 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-45d90645-6299-45c4-be4b-e82abd225865 req-7ed22246-0f59-469a-8c9d-ee1e07b9e321 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0661945 Nov 18 21:05:59.081870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80780142-84aa-4613-8cff-c1aaefa0145d req-9161b32f-ad3b-425a-8fd9-dd8e331a050e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:59.084419 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-9161b32f-ad3b-425a-8fd9-dd8e331a050e service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0636835 Nov 18 21:05:59.173570 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80780142-84aa-4613-8cff-c1aaefa0145d req-b4802b9e-2103-4a54-be44-318a587a31ce service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:05:59.175504 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-b4802b9e-2103-4a54-be44-318a587a31ce service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0748355 Nov 18 21:05:59.291281 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-64af9c28-38d4-488b-ad20-f9dbb4f3b05f service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1032064 Nov 18 21:05:59.402465 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80780142-84aa-4613-8cff-c1aaefa0145d req-663ae4cf-57a6-4c72-bc54-647121a30d94 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1006036 Nov 18 21:06:00.164225 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d213e12-538e-4101-99ee-5be03f737410 req-e522bbf7-9c38-41b2-a824-df251372e224 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:00.165764 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0d213e12-538e-4101-99ee-5be03f737410 req-e522bbf7-9c38-41b2-a824-df251372e224 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 944 time: 0.0596836 Nov 18 21:06:00.223154 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0d213e12-538e-4101-99ee-5be03f737410 req-c160568e-d91c-440b-a029-3ff845452d9e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499549 Nov 18 21:06:01.361527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4546e412-cd5d-4f97-a0fc-aa5e6ec8ee19 req-18b29c6d-10b5-42f1-a17a-0d704aa47348 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:01.363009 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4546e412-cd5d-4f97-a0fc-aa5e6ec8ee19 req-18b29c6d-10b5-42f1-a17a-0d704aa47348 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 944 time: 0.0537271 Nov 18 21:06:01.410909 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 9f8d85f0-073b-4d3b-b9e3-f904463e7647 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:06:01.420662 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4546e412-cd5d-4f97-a0fc-aa5e6ec8ee19 req-5182d543-fbda-4f67-b802-38f6a246b6a0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0515454 Nov 18 21:06:01.633517 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:01.645685 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'port_id': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'mac_address': 'fa:16:3e:de:25:d7', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 635, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:06:01.684064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:01.697542 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 9f8d85f0-073b-4d3b-b9e3-f904463e7647 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:06:01.722311 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:01.726996 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:01.806254 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=9f8d85f0-073b-4d3b-b9e3-f904463e7647,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:02.143790 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['9f8d85f0-073b-4d3b-b9e3-f904463e7647'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:02.212600 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c1a3db83-dfbe-4b90-800d-04e2b34adfc7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:02.575819 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0560f47-e623-4765-a43f-bae4ffe931a5 req-c4cef0bd-1d23-48ca-9328-44f3dadfb96c tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:02.578643 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f0560f47-e623-4765-a43f-bae4ffe931a5 req-c4cef0bd-1d23-48ca-9328-44f3dadfb96c tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 945 time: 0.0777738 Nov 18 21:06:02.644255 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f0560f47-e623-4765-a43f-bae4ffe931a5 req-95bbf8ae-a75f-4066-8732-5d566a5901ae tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587971 Nov 18 21:06:03.419871 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 9f8d85f0-073b-4d3b-b9e3-f904463e7647 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:06:03.472315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00ce73fc-f0f3-437b-81f9-507133e7eb61 req-42b23de9-d093-4e6b-bf1f-6fad871a14e6 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:03.473925 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-00ce73fc-f0f3-437b-81f9-507133e7eb61 req-42b23de9-d093-4e6b-bf1f-6fad871a14e6 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0767033 Nov 18 21:06:03.490632 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:06:03.495513 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:06:03.495886 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:03.552085 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-00ce73fc-f0f3-437b-81f9-507133e7eb61 req-a95d8f66-8985-4de7-801f-b4d20a12e353 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0698285 Nov 18 21:06:03.601067 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:03.633647 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:03.636096 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2f21f137-e8dc-473e-b7f0-3b5cb65b94f3" -d '{"events": [{"server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "name": "network-vif-plugged", "status": "completed", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:03.651761 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:03.657314 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:03.693003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4ffca727-1c80-44a3-ada1-d413260255de x-openstack-request-id: req-4ffca727-1c80-44a3-ada1-d413260255de {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:03.693003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "name": "network-vif-plugged", "status": "completed", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:03.693003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-4ffca727-1c80-44a3-ada1-d413260255de {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:03.702339 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'code': 200} Nov 18 21:06:03.745367 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=9f8d85f0-073b-4d3b-b9e3-f904463e7647,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:03.804409 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4a884b1-5bf3-4251-ab80-8a56729bcaa7 req-2c0340c6-41cb-4a18-8ab4-e4e32c891ab7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:03.806202 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e4a884b1-5bf3-4251-ab80-8a56729bcaa7 req-2c0340c6-41cb-4a18-8ab4-e4e32c891ab7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0660982 Nov 18 21:06:03.876781 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e4a884b1-5bf3-4251-ab80-8a56729bcaa7 req-8e9ce6f4-adc6-4c03-8f12-2b83529419c4 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609806 Nov 18 21:06:03.941328 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-11c920e6-4834-46fa-9e7b-38faef483cdb req-9a0d657a-e7d1-4bed-86b7-a42016af5aca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:03.943053 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-11c920e6-4834-46fa-9e7b-38faef483cdb req-9a0d657a-e7d1-4bed-86b7-a42016af5aca service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1099 time: 0.0460792 Nov 18 21:06:04.005697 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-11c920e6-4834-46fa-9e7b-38faef483cdb req-61256dc6-d1be-4063-916f-248a5888acff service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0508130 Nov 18 21:06:04.625593 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6cb74cf0-4e05-49e9-b369-c173ec0f8b7c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:04.726525 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d28734e-00ee-48cf-be3d-47627108c974 req-b578facc-ee86-4bb0-abd5-6c5412ba697e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:04.728191 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d28734e-00ee-48cf-be3d-47627108c974 req-b578facc-ee86-4bb0-abd5-6c5412ba697e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0781331 Nov 18 21:06:04.780789 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d28734e-00ee-48cf-be3d-47627108c974 req-3f3c639c-b95b-4ce7-9516-9a49ede30bc4 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453527 Nov 18 21:06:05.035495 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bef93734-5946-4b3c-9791-3f67e0608955 req-b0c4fb41-832d-4885-8c71-243ab6e40663 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:05.038229 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bef93734-5946-4b3c-9791-3f67e0608955 req-b0c4fb41-832d-4885-8c71-243ab6e40663 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0688608 Nov 18 21:06:05.089749 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-bef93734-5946-4b3c-9791-3f67e0608955 req-a7f30f6d-631e-47b7-a2fe-d98e0396c500 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0451956 Nov 18 21:06:05.843353 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39768) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:05.985570 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ad8b335-f3ae-49a7-b380-5ac680231c35 req-e6192de6-bdd2-455c-834c-70859641fe3c tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:05.988136 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2ad8b335-f3ae-49a7-b380-5ac680231c35 req-e6192de6-bdd2-455c-834c-70859641fe3c tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0855656 Nov 18 21:06:06.005347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.006160 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.089325 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2ad8b335-f3ae-49a7-b380-5ac680231c35 req-ce95dab8-6bb4-48a1-b33e-dfc95f47b6e1 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0850844 Nov 18 21:06:06.178446 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-f951a74c-920e-4c24-926d-685e3d5a99d3 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:06.179963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-f951a74c-920e-4c24-926d-685e3d5a99d3 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 945 time: 0.0860517 Nov 18 21:06:06.186004 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.194829 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.252678 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d25dda91-f762-4fa4-8e2f-7f483f5a6439 req-8663a7a4-cd01-4c23-b878-9dc3ed93611a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:06.255286 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d25dda91-f762-4fa4-8e2f-7f483f5a6439 req-8663a7a4-cd01-4c23-b878-9dc3ed93611a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0716155 Nov 18 21:06:06.277331 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d221418bd08643deacea5e641b35499b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4326973 Nov 18 21:06:06.278987 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dbf30098-9025-4151-8c52-5ebb7ca8fe40,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:06.286029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39774) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:06.287499 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.287858 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.288242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.288628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.288921 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.289258 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.289596 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.289928 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.290264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.290597 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.290925 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.291250 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9d31b517-4e1f-4662-a381-55da9f3e2a66 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:06.329170 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d25dda91-f762-4fa4-8e2f-7f483f5a6439 req-e9babbc8-e042-4f8f-90a7-f62ac17a84e5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0672383 Nov 18 21:06:06.506260 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-26430657-b801-4e5f-88af-1a1262fc1a4e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.541290 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Deleting port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:06.541594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.546689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-26430657-b801-4e5f-88af-1a1262fc1a4e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.572732 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b142800-93ff-4dae-8456-55bf1bfcd1a3 req-6cb5d467-7d9c-4431-8df6-9db7b1cc6949 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:06.574317 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3b142800-93ff-4dae-8456-55bf1bfcd1a3 req-6cb5d467-7d9c-4431-8df6-9db7b1cc6949 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.1672795 Nov 18 21:06:06.584638 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 39778) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:06.589524 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'floatingip': {'port_id': '9f8d85f0-073b-4d3b-b9e3-f904463e7647'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:06.665530 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.678435 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] For port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:06.678980 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.690835 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-26430657-b801-4e5f-88af-1a1262fc1a4e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.694747 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-26430657-b801-4e5f-88af-1a1262fc1a4e admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.695972 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-26430657-b801-4e5f-88af-1a1262fc1a4e admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/dbf30098-9025-4151-8c52-5ebb7ca8fe40 HTTP/1.1" status: 204 len: 168 time: 0.4004688 Nov 18 21:06:06.707184 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Calling delete_port for 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:06:06.717300 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26430657-b801-4e5f-88af-1a1262fc1a4e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dbf30098-9025-4151-8c52-5ebb7ca8fe40,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:06.903982 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:06.919224 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:06.941375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Pushing event deleted for resources: {'Port': ['ID=0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:07.025353 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] No DVR routers for this DVR port 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:06:07.029165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.035104 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-23b99645-4d5b-44e9-9ed0-53d0f7571ea2 req-5c047e0f-642b-4288-a815-eca0a0a6404a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "DELETE /v2.0/ports/0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 HTTP/1.1" status: 204 len: 173 time: 0.8351095 Nov 18 21:06:07.035759 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'name': 'network-vif-deleted', 'tag': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:07.040076 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-227fabac-7b2f-4e47-b158-102f51d42691" -d '{"events": [{"server_uuid": "34d40996-cc8c-42a7-91a1-8d0d047527d6", "name": "network-vif-deleted", "tag": "0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:07.185116 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39794) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:07.222733 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2a43c556-d5a1-43e1-8cdb-e967fdd6730d admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.290391 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.301932 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.375410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2a43c556-d5a1-43e1-8cdb-e967fdd6730d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.389013 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2a43c556-d5a1-43e1-8cdb-e967fdd6730d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.456991 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-2a43c556-d5a1-43e1-8cdb-e967fdd6730d admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=6e6490b606af47c4a2fcddfd27bb86c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2670603 Nov 18 21:06:07.456991 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a43c556-d5a1-43e1-8cdb-e967fdd6730d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ca1fa01-edcc-4f48-bdd1-7aa69a435e9d,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:07.459425 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 39800) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:07.471785 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ddeea133-448e-42a1-8645-4548e99f4d3d req-233a05f2-79f0-45c0-88d5-56e79929e38e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=34d40996-cc8c-42a7-91a1-8d0d047527d6 HTTP/1.1" status: 200 len: 210 time: 0.0727022 Nov 18 21:06:07.474697 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-54bc1f20-3fa8-4ced-8ab2-eb990b3a3fac x-openstack-request-id: req-54bc1f20-3fa8-4ced-8ab2-eb990b3a3fac {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:07.474989 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "34d40996-cc8c-42a7-91a1-8d0d047527d6", "name": "network-vif-deleted", "tag": "0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:07.475259 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-54bc1f20-3fa8-4ced-8ab2-eb990b3a3fac {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:07.475749 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '34d40996-cc8c-42a7-91a1-8d0d047527d6', 'name': 'network-vif-deleted', 'tag': '0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0', 'status': 'completed', 'code': 200} Nov 18 21:06:07.506200 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.531038 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.l3_db [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Floating IP 8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84 associated. External IP: 172.27.3.31, port: 9f8d85f0-073b-4d3b-b9e3-f904463e7647. Nov 18 21:06:07.539733 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4b3b5c56-d2bc-4e43-83fa-74c02d05f9a8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.579987 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4b3b5c56-d2bc-4e43-83fa-74c02d05f9a8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.662876 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4b3b5c56-d2bc-4e43-83fa-74c02d05f9a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.665706 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4b3b5c56-d2bc-4e43-83fa-74c02d05f9a8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:07.666979 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-4b3b5c56-d2bc-4e43-83fa-74c02d05f9a8 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/5ca1fa01-edcc-4f48-bdd1-7aa69a435e9d HTTP/1.1" status: 204 len: 168 time: 0.2061541 Nov 18 21:06:07.685046 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b3b5c56-d2bc-4e43-83fa-74c02d05f9a8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ca1fa01-edcc-4f48-bdd1-7aa69a435e9d,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:08.069791 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:06:08.230636 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:06:08.236283 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:08.253781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:06:08.264194 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:08.270121 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:08.270807 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:08.281564 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-9315554f-d65c-4139-bd46-6bb80bbf1d0e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "PUT /v2.0/floatingips/8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84 HTTP/1.1" status: 200 len: 991 time: 1.6956830 Nov 18 21:06:08.282276 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:08.289475 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76" -d '{"events": [{"name": "network-changed", "server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:08.478458 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:08.587716 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-359b8185-3d01-42c6-ba8d-24bbff4ebbac x-openstack-request-id: req-359b8185-3d01-42c6-ba8d-24bbff4ebbac {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:08.588635 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:08.589098 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-359b8185-3d01-42c6-ba8d-24bbff4ebbac {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:08.589671 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'status': 'completed', 'code': 200} Nov 18 21:06:08.714982 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-8e5edeae-1cb5-46bb-bbcf-60201aa2d2a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:08.717888 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-8e5edeae-1cb5-46bb-bbcf-60201aa2d2a6 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1099 time: 0.0937045 Nov 18 21:06:08.972343 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-08795396-31f5-4ea2-adeb-721e48141dbc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:08.974053 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-08795396-31f5-4ea2-adeb-721e48141dbc service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.2484839 Nov 18 21:06:08.977942 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'floating_ip_address': '172.27.3.31', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'port_id': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'mac_address': 'fa:16:3e:de:25:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:05:46Z', 'updated_at': '2021-11-18T21:06:07Z', 'revision_number': 1, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:09.021690 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:06:09.030996 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:09.031904 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:09.067404 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-b7b284f7-dd69-423b-9261-7268e3239276 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 999 time: 0.0828922 Nov 18 21:06:09.153676 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-b9e03b41-e62f-48d9-88d7-aea13324f467 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:09.156480 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-b9e03b41-e62f-48d9-88d7-aea13324f467 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0760338 Nov 18 21:06:09.165242 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:09.237490 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-e70e23b3-c1d6-4d09-a903-3a8b1e80745a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:09.239300 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-e70e23b3-c1d6-4d09-a903-3a8b1e80745a service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0704749 Nov 18 21:06:09.415309 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8eab9b3f-80ba-4731-8034-306e098268db req-2398e660-9d3f-45ed-bbe4-4c48a4ce82b6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:09.424856 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8eab9b3f-80ba-4731-8034-306e098268db req-2398e660-9d3f-45ed-bbe4-4c48a4ce82b6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0813773 Nov 18 21:06:09.505940 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'floating_ip_address': '172.27.3.31', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'port_id': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'mac_address': 'fa:16:3e:de:25:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:05:46Z', 'updated_at': '2021-11-18T21:06:07Z', 'revision_number': 1, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:09.506905 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8eab9b3f-80ba-4731-8034-306e098268db req-07bff659-f703-4b43-8bf6-73e389bf61c4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0805748 Nov 18 21:06:09.535661 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f45efda2-ba93-4589-85d5-19d77c7fc017 None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'floating_ip_address': '172.27.3.31', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'port_id': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 502, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'mac_address': 'fa:16:3e:de:25:d7', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:05:46Z', 'updated_at': '2021-11-18T21:06:07Z', 'revision_number': 1, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:06:09.791914 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-19d4b256-cf14-47e2-9737-a4d527b15d6d None None] New status for floating IP 8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84: ACTIVE {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:06:10.134941 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:06:10.167163 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:06:10.167651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 0f4b3c39-fbc2-4fe1-9a68-69ccca7f54e0 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:06:10.640340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ff76b1f-8c33-46b8-b810-c92ff6ed60aa req-279bec6e-1d68-4090-9927-fddb2bba9df6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:10.641857 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9ff76b1f-8c33-46b8-b810-c92ff6ed60aa req-279bec6e-1d68-4090-9927-fddb2bba9df6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0544689 Nov 18 21:06:10.691581 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9ff76b1f-8c33-46b8-b810-c92ff6ed60aa req-4dccfc4e-94fd-4b34-8efd-7ce8c62cac6b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438387 Nov 18 21:06:11.816159 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ca0064e-97ec-45f5-85e0-97a42c4b798d req-62d1202b-4401-4f48-821b-5e2c182fc174 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:11.817698 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0ca0064e-97ec-45f5-85e0-97a42c4b798d req-62d1202b-4401-4f48-821b-5e2c182fc174 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0512717 Nov 18 21:06:11.874641 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0ca0064e-97ec-45f5-85e0-97a42c4b798d req-8b9cba2b-01e7-4ddb-8791-0ee5b418a0de tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0507374 Nov 18 21:06:12.089908 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-749c878e-9a37-4633-9dc3-fd5f786c8db9 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1206117 Nov 18 21:06:12.207879 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4f30a515-7fd4-4ffd-a19e-6d40c4126f76 req-43370fa5-e87c-4d00-a1ca-fda1c139b17f service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1050487 Nov 18 21:06:13.063122 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c96832c6-336f-43e8-869c-b5c58c1ff882 req-9069707a-fbd3-4b96-be31-d35607757f36 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:13.065669 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c96832c6-336f-43e8-869c-b5c58c1ff882 req-9069707a-fbd3-4b96-be31-d35607757f36 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0796263 Nov 18 21:06:13.144332 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c96832c6-336f-43e8-869c-b5c58c1ff882 req-eac22779-2621-4bb1-83a0-124404d9f973 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0683143 Nov 18 21:06:14.298732 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-746fb858-36c2-460c-89b6-2f7fb1a99b7a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:14.300245 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-746fb858-36c2-460c-89b6-2f7fb1a99b7a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0833926 Nov 18 21:06:14.328019 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d9f8b19-a5e4-4ab2-832d-674ffb8601cb req-09a632f1-fb7f-4e6b-b5f0-5c55ecdd54eb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:14.329571 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d9f8b19-a5e4-4ab2-832d-674ffb8601cb req-09a632f1-fb7f-4e6b-b5f0-5c55ecdd54eb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 947 time: 0.0840678 Nov 18 21:06:14.460851 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d9f8b19-a5e4-4ab2-832d-674ffb8601cb req-c61a3788-5626-4883-85e5-30d906f94904 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=41378fa0-8beb-4fcf-8751-adebc0223629&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0943310 Nov 18 21:06:14.482424 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Deleting port 36578666-b0b7-4111-a019-33bc4c0ac780 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:14.482898 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:14.607478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] For port 36578666-b0b7-4111-a019-33bc4c0ac780, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=36578666-b0b7-4111-a019-33bc4c0ac780,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:14.607838 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:14.854038 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:14.854395 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:14.854711 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Floating IP b43a547e-8a0b-4ccc-91af-2bacb1f171f0 disassociated. External IP: 172.27.3.120, port: 36578666-b0b7-4111-a019-33bc4c0ac780. Nov 18 21:06:14.855046 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Calling delete_port for 36578666-b0b7-4111-a019-33bc4c0ac780 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:06:15.007847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:15.037501 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event deleted for resources: {'Port': ['ID=36578666-b0b7-4111-a019-33bc4c0ac780,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:15.156360 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:06:15.268560 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:06:15.280189 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:06:15.294529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:15.294938 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:15.326807 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] No DVR routers for this DVR port 36578666-b0b7-4111-a019-33bc4c0ac780 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:06:15.329581 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:15.335149 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-762aa5af-d583-465e-9aea-7a5d30af1685 req-a6a42723-4280-45e6-87b6-b879b110bab6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "DELETE /v2.0/ports/36578666-b0b7-4111-a019-33bc4c0ac780 HTTP/1.1" status: 204 len: 173 time: 1.0214694 Nov 18 21:06:15.335861 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-deleted', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:15.349642 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6ca9ca20-1ce7-4902-86eb-f51693675ac0" -d '{"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-deleted", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:15.403846 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-14547eba-f926-440a-a242-f5f613ea1f09 x-openstack-request-id: req-14547eba-f926-440a-a242-f5f613ea1f09 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:15.404352 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "789be9b3-801b-4509-a4d0-67d34902d3eb", "name": "network-vif-deleted", "tag": "36578666-b0b7-4111-a019-33bc4c0ac780", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:15.404753 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-14547eba-f926-440a-a242-f5f613ea1f09 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:15.405320 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '789be9b3-801b-4509-a4d0-67d34902d3eb', 'name': 'network-vif-deleted', 'tag': '36578666-b0b7-4111-a019-33bc4c0ac780', 'status': 'completed', 'code': 200} Nov 18 21:06:15.423399 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:15.643930 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-54bba88d-5e39-41a6-a38b-846f801a3dd6 req-468f1f9b-5934-49de-8a03-2d9d3c2c1bd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.0369275 Nov 18 21:06:15.804086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:15.834571 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:06:15.847485 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:15.848313 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:15.982529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:16.268659 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:16.297443 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-40e91312-e5b0-4a20-941f-6919d48e0ebb None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:06:16.557587 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8094302f-abdf-4920-952c-78b895ff864f None None] New status for floating IP b43a547e-8a0b-4ccc-91af-2bacb1f171f0: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:06:16.788438 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-927ff0ef-cc18-4537-94cb-c64cf9e85525 req-f7e73c52-8d2b-4bdb-a418-bfbfd08a114d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.0404735 Nov 18 21:06:17.934466 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bb8fbfd7-c285-4433-81b5-867f632cc078 req-e0d148cd-b615-4e88-b586-ce744b4f97ab tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=789be9b3-801b-4509-a4d0-67d34902d3eb HTTP/1.1" status: 200 len: 210 time: 0.0311894 Nov 18 21:06:19.021447 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4c5a12a2-2ca7-40a9-9f6e-9da942c678f6 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:19.023759 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4c5a12a2-2ca7-40a9-9f6e-9da942c678f6 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/networks?id=9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 200 len: 813 time: 0.1216443 Nov 18 21:06:19.050997 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-f428d333-afbe-414c-9857-02c16e0fa48e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/quotas/54afe6a32ce84eeca2df58c524125ab7 HTTP/1.1" status: 200 len: 375 time: 0.0167534 Nov 18 21:06:19.057095 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40000) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:19.116954 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-e293b9ac-36ec-44be-8635-227aa0d919ab tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=54afe6a32ce84eeca2df58c524125ab7&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0481844 Nov 18 21:06:19.213853 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-db4266a5-ca5d-492c-b325-b6fd42224fd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.273560 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-db4266a5-ca5d-492c-b325-b6fd42224fd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.288872 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-a465779e-9e10-4b98-a43c-892e2ca6d26e service neutron] 10.222.0.61 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1599689 Nov 18 21:06:19.366015 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.386582 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-db4266a5-ca5d-492c-b325-b6fd42224fd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.389895 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-db4266a5-ca5d-492c-b325-b6fd42224fd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.391037 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-db4266a5-ca5d-492c-b325-b6fd42224fd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "DELETE /v2.0/security-groups/41378fa0-8beb-4fcf-8751-adebc0223629 HTTP/1.1" status: 204 len: 168 time: 0.3325322 Nov 18 21:06:19.393983 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40004) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:19.410573 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db4266a5-ca5d-492c-b325-b6fd42224fd1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=41378fa0-8beb-4fcf-8751-adebc0223629,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:19.410800 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.api.v2.resource [None req-2a85822a-c995-4e9b-9485-0d639b3d9a41 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] show failed (client error): The resource could not be found. Nov 18 21:06:19.411750 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-2a85822a-c995-4e9b-9485-0d639b3d9a41 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups/41378fa0-8beb-4fcf-8751-adebc0223629 HTTP/1.1" status: 404 len: 347 time: 0.0167441 Nov 18 21:06:19.415692 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40006) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:19.424389 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-35f3085a-8460-4111-8866-a3e856a19804 service neutron] 10.222.0.61 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1275194 Nov 18 21:06:19.572792 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Deleting port efc13cab-bca4-4f27-bd41-4771fddb9fcc {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:19.573135 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.634675 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-019e3151-de7b-4db7-92b4-3d68d2b245a2 req-ca63bde3-2bd9-4801-96f3-6b84788292ab tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 210 time: 0.0490701 Nov 18 21:06:19.702781 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.703125 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.724634 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Calling delete_port for efc13cab-bca4-4f27-bd41-4771fddb9fcc owned by network:floatingip {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:06:19.922089 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:19.956756 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event deleted for resources: {'Port': ['ID=efc13cab-bca4-4f27-bd41-4771fddb9fcc,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:19.977791 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.978178 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.978497 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.978852 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.979193 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.979538 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.979868 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.980248 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.980631 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.981388 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.981722 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:19.982060 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:06:20.070208 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.074819 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.079019 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f6e493b0-005a-442c-89cf-d3d3a5bcf58c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "DELETE /v2.0/floatingips/b43a547e-8a0b-4ccc-91af-2bacb1f171f0 HTTP/1.1" status: 204 len: 168 time: 0.6607249 Nov 18 21:06:20.333281 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40024) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:20.338815 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'security_group': {'name': 'tempest-securitygroup--400833222', 'description': 'tempest-description--1271060920'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:20.366753 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.468495 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.473001 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.505035 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.506282 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.1719186 Nov 18 21:06:20.510115 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40026) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:20.511370 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439efd27-4030-48dc-92f1-e697ef56d274 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'SecurityGroup': ['ID=a5c84e6b-4dd1-4c46-b94d-2def5d569268,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:20.515392 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'security_group_rule': {'security_group_id': 'a5c84e6b-4dd1-4c46-b94d-2def5d569268', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:20.556221 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.619237 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.626998 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.656533 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=776d797f-9f37-489a-a432-0ca90e94f7cd,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:20.668479 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.670562 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-e5b0b878-2056-4cdd-92a5-46ba726a0a95 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1591618 Nov 18 21:06:20.673581 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40030) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:20.681458 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'security_group_rule': {'security_group_id': 'a5c84e6b-4dd1-4c46-b94d-2def5d569268', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:20.730223 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.796963 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5ef10371-7635-43ee-a33a-8b259814a43a req-9ace8acd-bed6-4492-9156-4d753addd404 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 210 time: 0.0513949 Nov 18 21:06:20.836001 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.842918 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.873637 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d064e48-3eea-4b6c-87e0-25477e275980,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:20.886998 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.888446 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6223459e-bfc4-462a-aac9-e1f0486522f0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.2134533 Nov 18 21:06:20.893059 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40032) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:20.897496 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:20.946215 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-a3750110-64c8-460f-94f7-8e7dad611e9b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:20.947660 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-a3750110-64c8-460f-94f7-8e7dad611e9b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "GET /v2.0/networks?id=9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 200 len: 813 time: 0.1690419 Nov 18 21:06:20.948888 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:20.970191 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Request body: {'port': {'device_id': '45265faf-312c-4261-8f28-1c59b796b4fb', 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11', 'admin_state_up': True, 'tenant_id': '54afe6a32ce84eeca2df58c524125ab7'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:21.414791 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Made reservation on behalf of 54afe6a32ce84eeca2df58c524125ab7 for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:06:21.418939 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:21.429928 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:21.638119 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Allocated IP 172.27.3.12 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/f13090ba-306c-4b11-a0d3-54deba2c0271) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:06:21.644616 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Allocated IP 172.20.0.10 (9cb58b73-7745-413b-a6b6-30673daa4d11/71e073e2-1e60-4ca4-a663-24a014f3734d/02f29bff-eb49-4a99-b3b4-a0a30f0a0713) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:06:21.757930 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:06:21.791247 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 36578666-b0b7-4111-a019-33bc4c0ac780 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:06:21.791583 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 36578666-b0b7-4111-a019-33bc4c0ac780 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:06:21.850721 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:21.937736 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:21.955847 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0c145eea-a18c-423e-86f3-2ec0e3279f54 req-04315136-768b-46e0-a5e0-4cafdc9f66fa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 210 time: 0.0440900 Nov 18 21:06:21.971674 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.030523 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:06:22.037287 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:06:22.039944 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:06:22.068948 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'Port': ['ID=f13090ba-306c-4b11-a0d3-54deba2c0271,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:22.075783 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.134231 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Network 9cb58b73-7745-413b-a6b6-30673daa4d11 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:06:22.141961 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:06:22.144391 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:06:22.183524 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Pushing event updated for resources: {'Port': ['ID=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:22.242420 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:22.243139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.260595 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.273341 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-4018b413-faea-4bb7-a163-61e08a4e781e tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.3069987 Nov 18 21:06:22.300780 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Request body: {'port': {'device_id': '45265faf-312c-4261-8f28-1c59b796b4fb', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:22.325988 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.398614 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.667129 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.675243 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.786790 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'Port': ['ID=f13090ba-306c-4b11-a0d3-54deba2c0271,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:22.794795 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.826804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.828063 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-bf200e38-580d-472c-9056-9e366c994571 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.9340489 Nov 18 21:06:22.881414 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:06:22.889510 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.909448 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Transition to ACTIVE for port object 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:06:22.914297 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:22.985976 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Pushing event updated for resources: {'Port': ['ID=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:23.049347 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Attempting to bind port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:06:23.049671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Attempting to bind port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:06:23.050006 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Attempting to bind port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 on network 9cb58b73-7745-413b-a6b6-30673daa4d11 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:06:23.054811 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 on network 9cb58b73-7745-413b-a6b6-30673daa4d11 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:06:23.055132 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Attempting to bind port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 on network 9cb58b73-7745-413b-a6b6-30673daa4d11 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:06:23.060775 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 6, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:06:23.061115 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Checking segment: {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:06:23.061510 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Bound using segment: {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:06:23.061949 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Bound port: 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '598e0f87-4a96-43e2-99cc-de98be15abf0', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 627, 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:06:23.062312 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:23.119609 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-407cfe6b-e742-40ad-93e0-cb49c9cda2bb req-fa6e8cc9-f88a-4ec0-9067-4e4565fe01f1 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:23.122101 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-407cfe6b-e742-40ad-93e0-cb49c9cda2bb req-fa6e8cc9-f88a-4ec0-9067-4e4565fe01f1 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 944 time: 0.0783823 Nov 18 21:06:23.178983 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-4cba6b95-b687-482e-90a8-228289546db9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--400833222&fields=id&tenant_id=d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 267 time: 0.1134195 Nov 18 21:06:23.181193 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-407cfe6b-e742-40ad-93e0-cb49c9cda2bb req-41ea6487-a754-4fba-a429-089f9ef28dc2 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0527241 Nov 18 21:06:23.189965 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] For port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:06:23.194306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] For port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:06:23.204175 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:23.302149 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:23.303094 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:23.304799 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] 10.222.0.62 "PUT /v2.0/ports/02f29bff-eb49-4a99-b3b4-a0a30f0a0713 HTTP/1.1" status: 200 len: 1094 time: 1.0098314 Nov 18 21:06:23.307387 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45265faf-312c-4261-8f28-1c59b796b4fb', 'tag': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:23.310103 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79c9accd-7b16-401d-83d7-7a0801af59ff" -d '{"events": [{"name": "network-changed", "server_uuid": "45265faf-312c-4261-8f28-1c59b796b4fb", "tag": "02f29bff-eb49-4a99-b3b4-a0a30f0a0713"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:23.352677 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e01785c-5dcb-4d57-a553-7e6a6e6cd60d service neutron] Pushing event updated for resources: {'Port': ['ID=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:23.420532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d39c800d-671f-4c15-ab9a-59d3f405adbd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:23.422097 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d39c800d-671f-4c15-ab9a-59d3f405adbd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 816 time: 0.2210977 Nov 18 21:06:23.458934 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-e3778b5a-608a-49ca-bb54-34774beca2d6 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/quotas/d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 375 time: 0.0260398 Nov 18 21:06:23.462346 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-65d643ce-0093-4a88-893a-94d56188c285 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:23.465379 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-65d643ce-0093-4a88-893a-94d56188c285 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=54afe6a32ce84eeca2df58c524125ab7&device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 1097 time: 0.0869384 Nov 18 21:06:23.468733 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd1c723c-f65b-4b51-8660-99dd205c671d x-openstack-request-id: req-bd1c723c-f65b-4b51-8660-99dd205c671d {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:23.469174 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45265faf-312c-4261-8f28-1c59b796b4fb", "tag": "02f29bff-eb49-4a99-b3b4-a0a30f0a0713", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:23.469599 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-bd1c723c-f65b-4b51-8660-99dd205c671d {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:23.470210 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45265faf-312c-4261-8f28-1c59b796b4fb', 'tag': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713', 'status': 'completed', 'code': 200} Nov 18 21:06:23.541514 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-83b4a6b9-a19b-4029-8639-f075f1bde7a2 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713 HTTP/1.1" status: 200 len: 217 time: 0.0549982 Nov 18 21:06:23.602790 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-9d01d2f9-ed0b-46b5-88a8-0673ca26f9fc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1311231 Nov 18 21:06:23.615625 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-6b36ba4f-7330-4212-9c7a-1b6a64f12729 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:23.617928 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-6b36ba4f-7330-4212-9c7a-1b6a64f12729 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=71e073e2-1e60-4ca4-a663-24a014f3734d HTTP/1.1" status: 200 len: 853 time: 0.0631201 Nov 18 21:06:23.693698 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-0649f961-0060-46ff-ab75-e383a1458235 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=9cb58b73-7745-413b-a6b6-30673daa4d11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0671234 Nov 18 21:06:23.802178 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-b16a7174-eb7a-431d-aba3-44410358f09d service neutron] 10.222.0.61 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1840949 Nov 18 21:06:23.878816 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-aca29fd6-d47f-49fc-9c0a-98ecfa030d44 service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1733663 Nov 18 21:06:23.982791 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-1f0655f7-a423-46de-a225-1e256f759f12 service neutron] 10.222.0.61 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1704319 Nov 18 21:06:24.022598 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-00d1bf9f-dc58-4438-924a-71aa0ce62b1b req-7417a48d-c7ec-4003-af5e-b965bb422c72 service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1251934 Nov 18 21:06:24.155984 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-ff88510d-6d7c-4a53-bb7b-8d9b6f19ab2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:24.158742 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-ff88510d-6d7c-4a53-bb7b-8d9b6f19ab2a service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=54afe6a32ce84eeca2df58c524125ab7&device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 1097 time: 0.0601351 Nov 18 21:06:24.215859 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-24877400-884a-45fd-9e22-fa83971d7838 req-820fb6b1-0461-4ab1-b71a-adf0ed85a072 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 210 time: 0.0480309 Nov 18 21:06:24.368956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-c3c3927f-5e95-4374-ad41-c9c8bdb38185 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:24.370508 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-c3c3927f-5e95-4374-ad41-c9c8bdb38185 service neutron] 10.222.0.62 "GET /v2.0/networks?id=9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 200 len: 914 time: 0.2007596 Nov 18 21:06:24.390076 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ad5b4b3-425a-4f4f-be31-b059d95cfc09 req-2faa07d6-956b-4744-8ad8-a3bf1383c2d5 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:24.391758 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5ad5b4b3-425a-4f4f-be31-b059d95cfc09 req-2faa07d6-956b-4744-8ad8-a3bf1383c2d5 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 944 time: 0.0954475 Nov 18 21:06:24.450034 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-b2f1c7c8-5535-4a30-ab94-2c1ec569ab2e service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713 HTTP/1.1" status: 200 len: 217 time: 0.0566494 Nov 18 21:06:24.581030 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5ad5b4b3-425a-4f4f-be31-b059d95cfc09 req-f59385b5-2ec1-4ff4-8932-52c35b2cc734 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1793499 Nov 18 21:06:24.596704 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-b8807118-aead-456c-8130-74a90c5ee5e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:24.599172 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-b8807118-aead-456c-8130-74a90c5ee5e7 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=71e073e2-1e60-4ca4-a663-24a014f3734d HTTP/1.1" status: 200 len: 853 time: 0.1376188 Nov 18 21:06:24.651801 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-5aca32e6-09c7-4c55-9253-ab3468d3210a service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=9cb58b73-7745-413b-a6b6-30673daa4d11&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0378966 Nov 18 21:06:24.796023 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-99c3a7f8-df52-4c8b-a58e-646286bc170d service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1314135 Nov 18 21:06:24.801965 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:06:24.930426 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79c9accd-7b16-401d-83d7-7a0801af59ff req-c7a6df31-4683-47b1-b61d-c4ddec032eaf service neutron] 10.222.0.62 "GET /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1206861 Nov 18 21:06:25.348983 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e8f415b4-2f9c-470d-a8cd-5aec3da8a41c req-6bea4682-3c1c-497e-a134-2a6a7a58f612 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 210 time: 0.0320308 Nov 18 21:06:25.506135 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-2c5d8fde-a138-49b7-8dcd-ca86226f2b85 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:25.507710 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-2c5d8fde-a138-49b7-8dcd-ca86226f2b85 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 816 time: 0.1388352 Nov 18 21:06:25.623627 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-60b98cd0-3f3e-43c1-be16-0e1f27acd482 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 379 time: 0.0975649 Nov 18 21:06:25.643909 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'port': {'device_id': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'admin_state_up': True, 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'security_groups': ['a5c84e6b-4dd1-4c46-b94d-2def5d569268']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:25.747950 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4dd8e886-aa0d-4d49-87c6-a9b44653166f req-68d5a084-aac2-43f2-b285-f9613f8005ea tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:25.749751 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4dd8e886-aa0d-4d49-87c6-a9b44653166f req-68d5a084-aac2-43f2-b285-f9613f8005ea tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 944 time: 0.0619473 Nov 18 21:06:25.756183 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:06:25.801508 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Made reservation on behalf of d6128eda2acb42f3b896c4d4a809ed0e for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:06:25.805247 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:25.821417 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4dd8e886-aa0d-4d49-87c6-a9b44653166f req-e843f243-0d4b-46cb-bf5b-3a3849fad937 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649171 Nov 18 21:06:25.924213 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:25.943525 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713', 'network_id': '9cb58b73-7745-413b-a6b6-30673daa4d11', 'port_id': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713', 'mac_address': 'fa:16:3e:00:e0:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 627, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '71e073e2-1e60-4ca4-a663-24a014f3734d', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:06:26.000806 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Allocated IP 172.20.0.4 (c212623b-e2b5-4f51-9cd5-a24f8a69f653/bc253697-be56-4044-aeb5-455225f5b7ab/4dae9221-3452-4f87-b4f2-0cdad7652d8c) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:06:26.011507 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.032552 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:06:26.055533 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:26.061066 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.119817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:26.185805 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.232982 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.283166 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:06:26.286391 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:06:26.290162 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:06:26.297323 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:26.349548 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:26.350379 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.374439 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-d9671774-6cdb-40fc-a6cc-d17fe9847edf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.7393694 Nov 18 21:06:26.391201 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Request body: {'port': {'device_id': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:26.419956 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['02f29bff-eb49-4a99-b3b4-a0a30f0a0713'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:26.497286 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.579449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8746db26-8f8c-4746-b084-ba3cc6020a48 req-85bd4f6f-33af-47cc-9c50-2732e8fb6db1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:26.581030 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8746db26-8f8c-4746-b084-ba3cc6020a48 req-85bd4f6f-33af-47cc-9c50-2732e8fb6db1 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 931 time: 0.0993831 Nov 18 21:06:26.623769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-e137c551-a47e-4ac0-85d2-730e59c556a0 None None] Provisioning complete for port 4dae9221-3452-4f87-b4f2-0cdad7652d8c triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:06:26.624169 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e137c551-a47e-4ac0-85d2-730e59c556a0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.673810 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-e137c551-a47e-4ac0-85d2-730e59c556a0 None None] Port 4dae9221-3452-4f87-b4f2-0cdad7652d8c cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:06:26.715311 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8746db26-8f8c-4746-b084-ba3cc6020a48 req-02ac6afa-9dd0-4211-8995-669737f40328 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1270709 Nov 18 21:06:26.893956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4dae9221-3452-4f87-b4f2-0cdad7652d8c {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:06:26.902331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:26.916647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Transition to ACTIVE for port object 4dae9221-3452-4f87-b4f2-0cdad7652d8c will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:06:26.922056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:27.008286 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:27.067908 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31eea378-0266-4270-bac3-3d75e0fbe43a req-a6df632b-a0bf-4c66-84f5-f6d03ac40258 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:27.069566 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-31eea378-0266-4270-bac3-3d75e0fbe43a req-a6df632b-a0bf-4c66-84f5-f6d03ac40258 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 945 time: 0.1436803 Nov 18 21:06:27.142014 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Attempting to bind port 4dae9221-3452-4f87-b4f2-0cdad7652d8c on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:06:27.142577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Attempting to bind port 4dae9221-3452-4f87-b4f2-0cdad7652d8c by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:06:27.143095 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Attempting to bind port 4dae9221-3452-4f87-b4f2-0cdad7652d8c on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:06:27.159319 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Port 4dae9221-3452-4f87-b4f2-0cdad7652d8c on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:06:27.159819 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Attempting to bind port 4dae9221-3452-4f87-b4f2-0cdad7652d8c on network c212623b-e2b5-4f51-9cd5-a24f8a69f653 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:06:27.169615 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-31eea378-0266-4270-bac3-3d75e0fbe43a req-4a55ce08-7cc8-494a-adda-921a00f150c3 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0921762 Nov 18 21:06:27.181449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 6, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:06:27.182173 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Checking segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:06:27.183231 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Bound using segment: {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:06:27.186335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Bound port: 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '92b0e715-6270-4ec3-92fa-a68032c1ba37', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 614, 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:06:27.187304 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:27.310872 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:06:27.316168 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:06:27.324834 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:27.372284 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:27.372284 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:27.372981 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] 10.222.0.62 "PUT /v2.0/ports/4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 200 len: 1093 time: 0.9866555 Nov 18 21:06:27.373664 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:27.376063 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2556a291-f51c-4ca3-b0ec-40c8feacdecd" -d '{"events": [{"name": "network-changed", "server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:27.408752 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-609857ee-5d7e-40ce-a664-244c66fb93bd service neutron] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:27.442420 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c885017c-a487-41df-bd7e-afe1b39980ac x-openstack-request-id: req-c885017c-a487-41df-bd7e-afe1b39980ac {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:27.442800 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:27.443264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c885017c-a487-41df-bd7e-afe1b39980ac {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:27.443910 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'status': 'completed', 'code': 200} Nov 18 21:06:27.488269 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-8c91d197-32ff-4760-847a-b62c7d12b768 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:27.489976 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-8c91d197-32ff-4760-847a-b62c7d12b768 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1096 time: 0.0587194 Nov 18 21:06:27.543781 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-db0b65ad-5574-4333-aceb-4a672e236773 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 200 len: 217 time: 0.0428636 Nov 18 21:06:27.614484 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-5968b9dd-3aa9-4768-ae79-d3e9a7222ea3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:27.616096 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-5968b9dd-3aa9-4768-ae79-d3e9a7222ea3 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0621705 Nov 18 21:06:27.670290 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-c8d46761-1a83-40fa-b9bc-8074c8f78bd3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:27.672530 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-c8d46761-1a83-40fa-b9bc-8074c8f78bd3 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0470476 Nov 18 21:06:27.770024 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:06:27.796198 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-427dc3fb-3713-43a7-b25a-d1466a3ba689 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1118205 Nov 18 21:06:27.870262 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:06:27.877473 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:06:27.877934 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:27.988023 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:28.019032 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45265faf-312c-4261-8f28-1c59b796b4fb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:28.021417 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-ae44d26f-afec-4cd1-8e2f-5bcd07cbfd35" -d '{"events": [{"server_uuid": "45265faf-312c-4261-8f28-1c59b796b4fb", "name": "network-vif-plugged", "status": "completed", "tag": "02f29bff-eb49-4a99-b3b4-a0a30f0a0713"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:28.041030 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:28.047474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:28.109995 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:28.215880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c1277943-d4dd-49ca-8199-827fb82176e5 x-openstack-request-id: req-c1277943-d4dd-49ca-8199-827fb82176e5 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:28.216461 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "45265faf-312c-4261-8f28-1c59b796b4fb", "name": "network-vif-plugged", "status": "completed", "tag": "02f29bff-eb49-4a99-b3b4-a0a30f0a0713", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:28.216936 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c1277943-d4dd-49ca-8199-827fb82176e5 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:28.217619 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45265faf-312c-4261-8f28-1c59b796b4fb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713', 'code': 200} Nov 18 21:06:28.258211 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41400e6a-454b-4c38-99c2-b28320d697cc req-dc067405-ebc6-47b1-a96c-65dcb3e40472 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.259816 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-41400e6a-454b-4c38-99c2-b28320d697cc req-dc067405-ebc6-47b1-a96c-65dcb3e40472 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0865791 Nov 18 21:06:28.263082 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24ff1598-3bf9-48d7-bed9-0d6ef7843242 req-36c50ad1-ec09-425c-9588-190ab9131733 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4591262 Nov 18 21:06:28.330595 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-41400e6a-454b-4c38-99c2-b28320d697cc req-05d964dc-ddef-464d-8d0b-51a398e68ac9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0585222 Nov 18 21:06:28.358528 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce635e8-056a-4373-b769-9abeee04dcc4 req-54f5c9f2-e85d-44d2-8094-32f117cfed45 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.360444 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8ce635e8-056a-4373-b769-9abeee04dcc4 req-54f5c9f2-e85d-44d2-8094-32f117cfed45 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.0696661 Nov 18 21:06:28.405155 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-7dad097a-e6a5-45c7-b699-9043befb4ff9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.406479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-7dad097a-e6a5-45c7-b699-9043befb4ff9 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1096 time: 0.0554490 Nov 18 21:06:28.431178 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8ce635e8-056a-4373-b769-9abeee04dcc4 req-ba35890c-fe48-4516-afe5-72a33e0bab18 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638554 Nov 18 21:06:28.541508 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ea35bc6-0f81-494b-8692-fa081265b13d req-b23aa47a-f66b-4425-bb71-6b35eacf288d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.543893 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4ea35bc6-0f81-494b-8692-fa081265b13d req-b23aa47a-f66b-4425-bb71-6b35eacf288d service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 1099 time: 0.1186392 Nov 18 21:06:28.570228 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-279f6d29-755a-4813-992d-b8e93c3f2261 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.571864 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-279f6d29-755a-4813-992d-b8e93c3f2261 service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.1486962 Nov 18 21:06:28.629474 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-fe5805fd-b04e-4277-b785-9a05d558a910 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 200 len: 217 time: 0.0487697 Nov 18 21:06:28.637163 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4ea35bc6-0f81-494b-8692-fa081265b13d req-9224ed11-de95-4e6a-bcdd-c58746e883f2 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0828757 Nov 18 21:06:28.697532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-615fa634-977e-47d6-bbb0-935d33929910 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.699517 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-615fa634-977e-47d6-bbb0-935d33929910 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0606296 Nov 18 21:06:28.924248 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-342ab703-772a-400c-99c7-b8d729c0f822 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:28.925729 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-342ab703-772a-400c-99c7-b8d729c0f822 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0575819 Nov 18 21:06:29.060052 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-89ef9fa3-2703-4ea7-aa60-cf4ad0ad7553 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1227005 Nov 18 21:06:29.193451 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2556a291-f51c-4ca3-b0ec-40c8feacdecd req-03a17489-ecfd-46b7-8c08-a031d2219b62 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1241672 Nov 18 21:06:29.497842 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab96acbf-c530-4d6b-8322-69393244924b req-dc4f36a5-9e48-452e-a251-eadf7a836610 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:29.500915 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ab96acbf-c530-4d6b-8322-69393244924b req-dc4f36a5-9e48-452e-a251-eadf7a836610 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0746865 Nov 18 21:06:29.589589 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ab96acbf-c530-4d6b-8322-69393244924b req-4e896653-5314-4207-b66e-cb6d0c3acf05 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0827982 Nov 18 21:06:29.624669 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6cca1e7-ca9d-443b-9b56-5e24dc58d430 req-3161d322-a6cb-42fa-9577-ac65e694061b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:29.626293 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6cca1e7-ca9d-443b-9b56-5e24dc58d430 req-3161d322-a6cb-42fa-9577-ac65e694061b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.0762572 Nov 18 21:06:29.686681 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6cca1e7-ca9d-443b-9b56-5e24dc58d430 req-0026d480-97e4-42a0-97c7-32045a12a259 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524702 Nov 18 21:06:30.754209 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c34a410-b9ee-4c65-952b-fd5fe084ce87 req-df477338-ba1f-4163-b1cc-2eb15b11efa4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:30.756697 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9c34a410-b9ee-4c65-952b-fd5fe084ce87 req-df477338-ba1f-4163-b1cc-2eb15b11efa4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0742142 Nov 18 21:06:30.824468 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9c34a410-b9ee-4c65-952b-fd5fe084ce87 req-8b6f0d66-5d44-4673-a082-b6769603d62f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0579286 Nov 18 21:06:30.829164 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b5315c-82ef-49be-b969-c4a334ef5331 req-ce26da55-ee6a-4709-9264-90c7ccf73a37 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:30.830987 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-49b5315c-82ef-49be-b969-c4a334ef5331 req-ce26da55-ee6a-4709-9264-90c7ccf73a37 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.0599051 Nov 18 21:06:30.892380 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-49b5315c-82ef-49be-b969-c4a334ef5331 req-a3016eb5-091e-44ae-9317-80d7c9b9727a tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0539451 Nov 18 21:06:31.772551 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:06:31.915943 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:31.942441 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'mac_address': 'fa:16:3e:f9:cd:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:06:32.011850 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:32.012690 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f2f6ce78-7b30-4dae-b83b-2253cbf766a8 req-c32e5c88-3eb3-49c1-84ba-3c134d42621c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:32.015229 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f2f6ce78-7b30-4dae-b83b-2253cbf766a8 req-c32e5c88-3eb3-49c1-84ba-3c134d42621c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0835092 Nov 18 21:06:32.037276 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4dae9221-3452-4f87-b4f2-0cdad7652d8c {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:06:32.073293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:32.079179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:32.090754 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f2f6ce78-7b30-4dae-b83b-2253cbf766a8 req-c206b488-64d8-4203-bd2c-a324de6dc575 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0684466 Nov 18 21:06:32.139978 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:32.192504 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f9d11677-69f1-43b6-9682-98bf4a3fc630 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:32.490578 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['4dae9221-3452-4f87-b4f2-0cdad7652d8c'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:33.242566 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a9f94d64-93d1-4c84-9fc7-cef191a9532f req-4e6379d4-85d3-4098-b12e-e7e3d9d1444a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:33.244173 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a9f94d64-93d1-4c84-9fc7-cef191a9532f req-4e6379d4-85d3-4098-b12e-e7e3d9d1444a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 944 time: 0.0629122 Nov 18 21:06:33.304588 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a9f94d64-93d1-4c84-9fc7-cef191a9532f req-91760b38-a5d9-407b-9658-49eade3535c0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0526907 Nov 18 21:06:33.789638 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:06:33.842222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 4dae9221-3452-4f87-b4f2-0cdad7652d8c completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:06:33.846522 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 4dae9221-3452-4f87-b4f2-0cdad7652d8c triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:06:33.846893 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:33.945966 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:33.970115 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:33.972329 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-496f3e86-d10e-487c-b112-6a92e5a23c06" -d '{"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-plugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:33.986795 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:33.991557 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:34.021867 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52484518-69b8-47de-b919-c2b4a87d72cc x-openstack-request-id: req-52484518-69b8-47de-b919-c2b4a87d72cc {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:34.022304 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-plugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:34.022713 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-52484518-69b8-47de-b919-c2b4a87d72cc {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:34.023274 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'code': 200} Nov 18 21:06:34.078358 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:34.249893 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2ff3094-ccb7-427c-98c5-aef3513eeccb req-af2d5637-957f-4c3b-aba8-a7bbc14fedc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:34.251469 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e2ff3094-ccb7-427c-98c5-aef3513eeccb req-af2d5637-957f-4c3b-aba8-a7bbc14fedc9 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1098 time: 0.0537081 Nov 18 21:06:34.308140 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e2ff3094-ccb7-427c-98c5-aef3513eeccb req-0500bed9-30c0-4725-9c77-214bcbd0df0c service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444982 Nov 18 21:06:34.509214 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e100505a-094b-4788-944b-0bbe30e70926 req-e0c9d4b9-36f6-4801-ac7c-53547834900b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:34.519177 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e100505a-094b-4788-944b-0bbe30e70926 req-e0c9d4b9-36f6-4801-ac7c-53547834900b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0976667 Nov 18 21:06:34.592506 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e100505a-094b-4788-944b-0bbe30e70926 req-80a35799-16ac-448e-a5ef-6585fe51fb5f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0713949 Nov 18 21:06:34.628880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-def4bcae-7a5e-49fe-a266-ab694036a84c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:35.844999 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c36901a7-dae7-41cb-910f-478733c00c48 req-7c31f0c7-50d3-4356-944f-e9b8f4007f09 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:35.848777 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c36901a7-dae7-41cb-910f-478733c00c48 req-7c31f0c7-50d3-4356-944f-e9b8f4007f09 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.1365106 Nov 18 21:06:35.943528 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c36901a7-dae7-41cb-910f-478733c00c48 req-694496f6-035c-4b2e-bd5d-c5028d6d0944 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0789480 Nov 18 21:06:36.023626 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.025411 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40216) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:36.158510 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0d00703-3e68-4c7d-9e7c-50474633644c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.245691 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0d00703-3e68-4c7d-9e7c-50474633644c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.251422 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0d00703-3e68-4c7d-9e7c-50474633644c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.300910 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f0d00703-3e68-4c7d-9e7c-50474633644c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d5c320cd3d49469a98d885f7f4d50408&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2751415 Nov 18 21:06:36.303086 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0d00703-3e68-4c7d-9e7c-50474633644c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6a7fb56d-d8fc-4c11-9507-cb2cba03f4ad,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:36.304165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40220) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:36.374313 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cd6f97d0-5120-4dcf-8d8b-ac667c502e27 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.402534 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cd6f97d0-5120-4dcf-8d8b-ac667c502e27 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.485635 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cd6f97d0-5120-4dcf-8d8b-ac667c502e27 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.489083 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cd6f97d0-5120-4dcf-8d8b-ac667c502e27 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:36.490309 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cd6f97d0-5120-4dcf-8d8b-ac667c502e27 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/6a7fb56d-d8fc-4c11-9507-cb2cba03f4ad HTTP/1.1" status: 204 len: 168 time: 0.1838179 Nov 18 21:06:36.498785 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cd6f97d0-5120-4dcf-8d8b-ac667c502e27 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6a7fb56d-d8fc-4c11-9507-cb2cba03f4ad,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:37.108475 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1fee731-a30f-4c4c-94ab-a8e80973b877 req-ae341767-3783-4e60-8501-23645660a24e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:37.110060 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b1fee731-a30f-4c4c-94ab-a8e80973b877 req-ae341767-3783-4e60-8501-23645660a24e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0684564 Nov 18 21:06:37.181864 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b1fee731-a30f-4c4c-94ab-a8e80973b877 req-0df31178-2bc4-45f4-959b-af8d64fef662 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0620406 Nov 18 21:06:37.349797 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed0307a8-5de5-4b65-8853-a42a9466506a req-0a547953-ab65-4ff0-9c3f-07bb482161e9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:37.351398 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ed0307a8-5de5-4b65-8853-a42a9466506a req-0a547953-ab65-4ff0-9c3f-07bb482161e9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0797944 Nov 18 21:06:37.363333 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40232) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:37.369780 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Request body: {'floatingip': {'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:37.419188 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:37.465598 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:38.016412 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:38.020723 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:38.138004 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.l3_db [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Floating IP ccac4be5-c314-4ead-8886-c17f6ea42387 associated. External IP: 172.27.3.12, port: 4dae9221-3452-4f87-b4f2-0cdad7652d8c. Nov 18 21:06:38.260970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:38.418843 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:06:38.536212 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:06:38.541062 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:38.549916 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:06:38.564290 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:38.565209 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:38.580910 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-dd4d4133-feae-42f2-9e64-db9e3adb438c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "PUT /v2.0/floatingips/ccac4be5-c314-4ead-8886-c17f6ea42387 HTTP/1.1" status: 200 len: 990 time: 1.2161255 Nov 18 21:06:38.581719 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:38.585420 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e17160a-4edf-4c67-9afc-8497cd69517e" -d '{"events": [{"name": "network-changed", "server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:38.643731 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f7b5080a-2740-493d-8025-8c0bbf1b96e0 x-openstack-request-id: req-f7b5080a-2740-493d-8025-8c0bbf1b96e0 {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:38.644011 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:38.644315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f7b5080a-2740-493d-8025-8c0bbf1b96e0 {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:38.644694 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'status': 'completed', 'code': 200} Nov 18 21:06:38.748271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-c0c8fa68-6fc0-447f-a8dd-d7de015e7fa0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:38.749877 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-c0c8fa68-6fc0-447f-a8dd-d7de015e7fa0 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1098 time: 0.0608237 Nov 18 21:06:38.826445 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:38.893947 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-2944cc91-0b09-48db-abc6-b60529c892fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:38.896804 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-2944cc91-0b09-48db-abc6-b60529c892fb service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.1367970 Nov 18 21:06:38.991626 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-e208c440-3afb-4c3b-be73-1cd6103ea879 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 200 len: 998 time: 0.0854321 Nov 18 21:06:39.064244 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-0e98b710-ca2e-4bec-b9eb-ad3885ad99df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:39.069088 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-0e98b710-ca2e-4bec-b9eb-ad3885ad99df service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0665205 Nov 18 21:06:39.147730 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-6bd7f8f8-9dd2-4e27-aefc-36b305f54122 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:39.149573 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-6bd7f8f8-9dd2-4e27-aefc-36b305f54122 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0703855 Nov 18 21:06:39.170941 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'ccac4be5-c314-4ead-8886-c17f6ea42387', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'floating_ip_address': '172.27.3.12', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 531, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'mac_address': 'fa:16:3e:f9:cd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:06:22Z', 'updated_at': '2021-11-18T21:06:37Z', 'revision_number': 1, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:39.219819 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:06:39.234744 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:39.235012 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:39.275666 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-773cbe02-2fb0-4af4-9035-5f0c2e1afdc4 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1136067 Nov 18 21:06:39.352710 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:39.410588 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0e17160a-4edf-4c67-9afc-8497cd69517e req-8bb81e8c-9863-40dd-bc0b-5ae2a05aebcb service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1113133 Nov 18 21:06:39.639151 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'ccac4be5-c314-4ead-8886-c17f6ea42387', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'floating_ip_address': '172.27.3.12', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 531, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'mac_address': 'fa:16:3e:f9:cd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:06:22Z', 'updated_at': '2021-11-18T21:06:37Z', 'revision_number': 1, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:39.670493 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e8c6f9aa-21a5-477e-b8e7-95607112cb25 None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': 'ccac4be5-c314-4ead-8886-c17f6ea42387', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'floating_ip_address': '172.27.3.12', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'fixed_ip_address': '172.20.0.4', 'status': 'DOWN', 'standard_attr_id': 531, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'mac_address': 'fa:16:3e:f9:cd:0b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:06:22Z', 'updated_at': '2021-11-18T21:06:37Z', 'revision_number': 1, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:06:39.903414 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f814d92a-57d7-46f1-a31b-ca0c00e79844 None None] New status for floating IP ccac4be5-c314-4ead-8886-c17f6ea42387: ACTIVE {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:06:46.961677 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-dbcc3b39-62a4-43b4-808c-20a487de8bf8 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1716837952&fields=id&tenant_id=05d2b75b4995419da5138c25c602c16e HTTP/1.1" status: 200 len: 267 time: 0.0777063 Nov 18 21:06:47.023281 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-6286e9e6-2efd-4fac-b715-32b083191c3b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:47.024841 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-6286e9e6-2efd-4fac-b715-32b083191c3b tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 984 time: 0.0547719 Nov 18 21:06:47.037331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Request body: {'port': {'security_groups': ['eb79f9a0-0320-4d56-8fdc-62bf7176a220']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:06:47.124245 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.366029 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:47.402700 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.407657 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.424694 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e439a92d-6b32-4acc-93a3-91c54d8ca660'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:47.461956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:47.462637 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.464259 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6dd60068-c1f3-431b-b6e4-93eba3bf06d2 req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "PUT /v2.0/ports/e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 942 time: 0.4318252 Nov 18 21:06:47.464935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:47.467438 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-91abaf5f-c688-40e6-8e5f-c23fbc50f467" -d '{"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:47.473660 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40290) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:47.538411 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fe3376f8-3687-4316-96d9-a36cd883da6a x-openstack-request-id: req-fe3376f8-3687-4316-96d9-a36cd883da6a {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:47.538704 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:47.539101 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-fe3376f8-3687-4316-96d9-a36cd883da6a {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:47.539793 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'status': 'completed', 'code': 200} Nov 18 21:06:47.543419 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0969e2b6-b5cb-4ff3-bd6f-23be77c3ecb6 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event updated for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=7']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:47.656082 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-af8dd351-88ad-4dcf-b598-199bfbd42624 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.704457 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-af8dd351-88ad-4dcf-b598-199bfbd42624 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.739286 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e439a92d-6b32-4acc-93a3-91c54d8ca660'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:47.753096 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-dd9b729a-a707-4ed7-a726-2a11051e6563 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:47.753664 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-dd9b729a-a707-4ed7-a726-2a11051e6563 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1098 time: 0.1811292 Nov 18 21:06:47.938411 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-810d464d-594e-4130-84e0-c1be4a32a6ff None None] Provisioning complete for port e439a92d-6b32-4acc-93a3-91c54d8ca660 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:06:47.938708 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-810d464d-594e-4130-84e0-c1be4a32a6ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.970373 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-af8dd351-88ad-4dcf-b598-199bfbd42624 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.976296 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-af8dd351-88ad-4dcf-b598-199bfbd42624 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:47.977583 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-af8dd351-88ad-4dcf-b598-199bfbd42624 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "DELETE /v2.0/security-groups/503edafc-04c7-45d2-b641-984e7e555400 HTTP/1.1" status: 204 len: 168 time: 0.5029378 Nov 18 21:06:47.981351 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40302) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:47.983706 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-f2703afc-9312-4529-8eb5-7a85cd6d5a38 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:47.985307 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-f2703afc-9312-4529-8eb5-7a85cd6d5a38 service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.1803968 Nov 18 21:06:47.992643 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af8dd351-88ad-4dcf-b598-199bfbd42624 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=503edafc-04c7-45d2-b641-984e7e555400,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:48.111954 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-729acf56-d10f-475a-8103-d99a3b4f6672 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 1000 time: 0.1135974 Nov 18 21:06:48.194913 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-2a83c248-e277-4af9-873d-1a0bc0d71253 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:48.199991 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-2a83c248-e277-4af9-873d-1a0bc0d71253 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.0753937 Nov 18 21:06:48.232170 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Deleting port 661b4b72-77cf-4ae4-9921-4acc0e15baeb {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:48.232526 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:48.289432 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-d72247af-d143-4ef1-9399-8cc091984260 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:48.292479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-d72247af-d143-4ef1-9399-8cc091984260 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0659838 Nov 18 21:06:48.337906 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:48.338234 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:48.361925 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Calling delete_port for 661b4b72-77cf-4ae4-9921-4acc0e15baeb owned by network:floatingip {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:06:48.444345 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-5e4a3386-6de1-491d-9bf8-9b158895cf9a service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1337667 Nov 18 21:06:48.551934 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-91abaf5f-c688-40e6-8e5f-c23fbc50f467 req-f77ded92-4c69-480f-b3ac-7b5c8d7f05bd service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0969908 Nov 18 21:06:48.613569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:48.646054 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event deleted for resources: {'Port': ['ID=661b4b72-77cf-4ae4-9921-4acc0e15baeb,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:48.747695 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks [] for floatingip, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:48.748157 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.l3_db [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Floating IP c82dd081-137c-40d3-9573-203c9f26552f disassociated (deleted). External IP: 172.27.3.76, port: e439a92d-6b32-4acc-93a3-91c54d8ca660. Nov 18 21:06:49.265156 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Router 95e57f35-7985-470a-b802-3cb4e75797cd has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:06:49.368296 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:49.406933 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:06:49.411402 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:49.422624 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] Sync routers for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:06:49.439184 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:49.440056 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:49.443558 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-20047445-bf07-4d70-931a-5786def14563 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "DELETE /v2.0/floatingips/c82dd081-137c-40d3-9573-203c9f26552f HTTP/1.1" status: 204 len: 168 time: 1.4605811 Nov 18 21:06:49.444307 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:49.447404 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c9be4340-3962-4c12-899f-b2b00902fc21" -d '{"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:49.499259 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da61fb6a-9e5d-44af-8008-26b85f5b766b x-openstack-request-id: req-da61fb6a-9e5d-44af-8008-26b85f5b766b {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:49.499896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:49.500724 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-da61fb6a-9e5d-44af-8008-26b85f5b766b {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:49.501475 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'status': 'completed', 'code': 200} Nov 18 21:06:49.599558 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:49.611683 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-72252166-ce4e-46f5-bd7e-ba869b1e23d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:49.620719 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-72252166-ce4e-46f5-bd7e-ba869b1e23d5 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1098 time: 0.0607390 Nov 18 21:06:49.787704 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-ea41fda8-4564-406b-b928-8d7161271523 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:49.788604 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-ea41fda8-4564-406b-b928-8d7161271523 service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.1609545 Nov 18 21:06:49.923037 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-895318f2-c2e0-4037-8a32-67c78259af43 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 217 time: 0.0402679 Nov 18 21:06:49.949569 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:05Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:50.017044 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] Checking router: 95e57f35-7985-470a-b802-3cb4e75797cd for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:06:50.022266 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-86a41697-f328-4f46-8ba3-7c17de3aafe4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:50.023925 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-86a41697-f328-4f46-8ba3-7c17de3aafe4 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.0879586 Nov 18 21:06:50.038537 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:06:50.039616 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:50.141134 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-4d9d1fe5-a9a2-41dd-b5d8-5b9c37419822 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:50.142692 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-4d9d1fe5-a9a2-41dd-b5d8-5b9c37419822 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0632684 Nov 18 21:06:50.221970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:06:50.295324 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-af8343d1-126f-4133-9f1c-97db075e0bc5 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1300213 Nov 18 21:06:50.439648 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c9be4340-3962-4c12-899f-b2b00902fc21 req-d99eb190-283f-4151-8fe8-64389999eb33 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1224287 Nov 18 21:06:50.533702 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:05Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:06:50.566477 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ad21008-afc0-4336-8e81-12095fbcdffe None None] The sync data for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi is: [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:01:59Z', 'revision_number': 4, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'a615f218-b382-4149-860b-310ec91bd3fe', 'name': '', 'network_id': 'd912b0f3-c291-4df9-ad87-83ebffd63dae', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'mac_address': 'fa:16:3e:ad:a0:34', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_interface', 'standard_attr_id': 258, 'fixed_ips': [{'subnet_id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:58Z', 'updated_at': '2021-11-18T21:02:05Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'subnets': [{'id': '15d33670-10a1-4513-bd2b-7b0b1de2e25c', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:06:50.847981 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e58ccf85-e177-4b39-a9e8-136d16216ad5 None None] New status for floating IP c82dd081-137c-40d3-9573-203c9f26552f: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:06:51.726451 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-b52bef8b-f023-4af1-9cb3-08922eef9ed8 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0474885 Nov 18 21:06:51.846728 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-34f215ba-b536-499f-b2b3-76425e6d494b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:51.848377 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-34f215ba-b536-499f-b2b3-76425e6d494b service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=05d2b75b4995419da5138c25c602c16e&device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 1098 time: 0.0605047 Nov 18 21:06:52.045436 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-50b0bff6-baf5-4659-b317-bde4e640c244 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:52.047158 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-50b0bff6-baf5-4659-b317-bde4e640c244 service neutron] 10.222.0.62 "GET /v2.0/networks?id=d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 200 len: 916 time: 0.1639111 Nov 18 21:06:52.106607 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-bcd1314e-cc5c-414b-a10a-6ca10f4cc360 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.5&port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 200 len: 217 time: 0.0456712 Nov 18 21:06:52.181024 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-eee4ace9-77c6-4592-90d1-c21430e42663 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:52.183809 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-eee4ace9-77c6-4592-90d1-c21430e42663 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 200 len: 854 time: 0.0609112 Nov 18 21:06:52.262331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-3b66897e-32cc-4d89-950d-101f63ddf70f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:52.263810 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-3b66897e-32cc-4d89-950d-101f63ddf70f service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=d912b0f3-c291-4df9-ad87-83ebffd63dae&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0642920 Nov 18 21:06:52.406897 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-a81f2e49-8611-4189-ad4a-0c5da1f35e81 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1213534 Nov 18 21:06:52.541079 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-484bbc26-7532-40d1-ba0e-47c2226e992c req-641892b4-7a7f-47c9-9615-29b6ebec9497 service neutron] 10.222.0.62 "GET /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1238434 Nov 18 21:06:52.704793 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a916c5c-5b44-4a96-8db4-858f2ae308ce req-c5313d8c-d422-49e5-b018-267c8436cafb tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:52.707284 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0a916c5c-5b44-4a96-8db4-858f2ae308ce req-c5313d8c-d422-49e5-b018-267c8436cafb tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.0658438 Nov 18 21:06:52.768641 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0a916c5c-5b44-4a96-8db4-858f2ae308ce req-af8478db-e507-48b4-9355-bc94a96fbaf5 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0543513 Nov 18 21:06:53.542604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1ec9663-d4a0-42df-88a3-e24252132938 req-7f04abb5-b746-41b1-a538-e2d137c07c4d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:53.545026 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f1ec9663-d4a0-42df-88a3-e24252132938 req-7f04abb5-b746-41b1-a538-e2d137c07c4d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.0678973 Nov 18 21:06:53.636002 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f1ec9663-d4a0-42df-88a3-e24252132938 req-ce4e6bba-432e-4732-9ed4-486941d925dd tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0808568 Nov 18 21:06:53.924145 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6039bab-5b33-4d56-9d03-e31d7be13674 req-d396886e-63b3-467d-ae96-f43356c8eecb tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:53.926565 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f6039bab-5b33-4d56-9d03-e31d7be13674 req-d396886e-63b3-467d-ae96-f43356c8eecb tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.0771713 Nov 18 21:06:53.990670 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f6039bab-5b33-4d56-9d03-e31d7be13674 req-63450823-51be-4de3-83e4-1581bdce61f0 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525198 Nov 18 21:06:54.791619 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d36b579e-b40b-451c-83ae-defab520812b req-d12b6a91-552f-45b5-8690-7b76d986c30e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:54.793381 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d36b579e-b40b-451c-83ae-defab520812b req-d12b6a91-552f-45b5-8690-7b76d986c30e tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.0737269 Nov 18 21:06:54.853588 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d36b579e-b40b-451c-83ae-defab520812b req-3b87b24e-dee5-492f-9b2d-c471ece1ad8d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0538490 Nov 18 21:06:54.863517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-6358bba9-d6ad-4fd0-92a5-307d73cea5c7 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:54.869349 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-6358bba9-d6ad-4fd0-92a5-307d73cea5c7 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.0804291 Nov 18 21:06:54.966745 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Deleting port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:54.967584 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:55.083618 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] For port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,segment=NetworkSegment(598e0f87-4a96-43e2-99cc-de98be15abf0),segment_id=598e0f87-4a96-43e2-99cc-de98be15abf0)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:55.083978 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:55.108719 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Calling delete_port for 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:06:55.191347 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dace24ed-da60-4eff-9d68-85b43b6d2257 req-08e938db-a031-44ae-bdd9-c607189ee2b7 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:55.193610 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dace24ed-da60-4eff-9d68-85b43b6d2257 req-08e938db-a031-44ae-bdd9-c607189ee2b7 tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/ports?device_id=45265faf-312c-4261-8f28-1c59b796b4fb HTTP/1.1" status: 200 len: 946 time: 0.1056533 Nov 18 21:06:55.270982 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dace24ed-da60-4eff-9d68-85b43b6d2257 req-9343f457-1539-47da-820f-d738c1811c7b tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.61 "GET /v2.0/security-groups?id=040b98b0-a1d4-4e5e-81aa-ef1bba094812&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0704882 Nov 18 21:06:55.324654 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:55.341011 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['02f29bff-eb49-4a99-b3b4-a0a30f0a0713'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:55.353612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Pushing event deleted for resources: {'Port': ['ID=02f29bff-eb49-4a99-b3b4-a0a30f0a0713,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:55.397283 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] No DVR routers for this DVR port 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:06:55.403324 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:55.407543 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d5543e85-192d-41c6-be06-d456cd94e7fb req-87dbeb5f-7688-4e4f-9e86-3d7065fb1cfa tempest-VolumesSnapshotTestJSON-475561001 tempest-VolumesSnapshotTestJSON-475561001-project] 10.222.0.62 "DELETE /v2.0/ports/02f29bff-eb49-4a99-b3b4-a0a30f0a0713 HTTP/1.1" status: 204 len: 173 time: 0.5342338 Nov 18 21:06:55.408017 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45265faf-312c-4261-8f28-1c59b796b4fb', 'name': 'network-vif-deleted', 'tag': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:55.410562 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b264a7c6-de90-4e12-b072-180442b02e53" -d '{"events": [{"server_uuid": "45265faf-312c-4261-8f28-1c59b796b4fb", "name": "network-vif-deleted", "tag": "02f29bff-eb49-4a99-b3b4-a0a30f0a0713"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:55.459537 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fda595e5-34d0-44a7-aac3-2551486c8f4b x-openstack-request-id: req-fda595e5-34d0-44a7-aac3-2551486c8f4b {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:55.459835 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "45265faf-312c-4261-8f28-1c59b796b4fb", "name": "network-vif-deleted", "tag": "02f29bff-eb49-4a99-b3b4-a0a30f0a0713", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:55.460095 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-fda595e5-34d0-44a7-aac3-2551486c8f4b {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:55.460535 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45265faf-312c-4261-8f28-1c59b796b4fb', 'name': 'network-vif-deleted', 'tag': '02f29bff-eb49-4a99-b3b4-a0a30f0a0713', 'status': 'completed', 'code': 200} Nov 18 21:06:55.992135 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cffff8-fd83-4e87-b2e8-19d63701803e req-0b01b4a5-40b1-4ee4-8a43-315666233ea9 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:55.993795 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b6cffff8-fd83-4e87-b2e8-19d63701803e req-0b01b4a5-40b1-4ee4-8a43-315666233ea9 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.0591278 Nov 18 21:06:56.085155 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b6cffff8-fd83-4e87-b2e8-19d63701803e req-a1e33830-74e4-4291-9f83-25a71c6378c1 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/security-groups?id=eb79f9a0-0320-4d56-8fdc-62bf7176a220&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712225 Nov 18 21:06:56.111472 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-1f6d1aca-b2a7-4988-a7d0-a2bfd1c60e84 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:06:56.113108 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-1f6d1aca-b2a7-4988-a7d0-a2bfd1c60e84 tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.62 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 945 time: 0.0699835 Nov 18 21:06:56.236353 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Deleting port e439a92d-6b32-4acc-93a3-91c54d8ca660 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:56.236613 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:56.334418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] For port e439a92d-6b32-4acc-93a3-91c54d8ca660, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=e439a92d-6b32-4acc-93a3-91c54d8ca660,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:56.334418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:56.351229 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Calling delete_port for e439a92d-6b32-4acc-93a3-91c54d8ca660 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:06:56.510750 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:56.525262 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['e439a92d-6b32-4acc-93a3-91c54d8ca660'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:06:56.554735 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Pushing event deleted for resources: {'Port': ['ID=e439a92d-6b32-4acc-93a3-91c54d8ca660,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:06:56.611380 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] No DVR routers for this DVR port e439a92d-6b32-4acc-93a3-91c54d8ca660 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:06:56.614120 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:56.617730 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2c05ae5c-32b7-49c7-a912-0bd226f58e54 req-237f29ef-28bb-4765-b296-32eab80ccfff tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.62 "DELETE /v2.0/ports/e439a92d-6b32-4acc-93a3-91c54d8ca660 HTTP/1.1" status: 204 len: 173 time: 0.4963179 Nov 18 21:06:57.204344 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-06b70fe3-52d5-4991-916e-aa3d171924ef req-46f4d67a-ad22-4f7d-9e27-61ba3d86533d tempest-TestMinimumBasicScenario-1457661548 tempest-TestMinimumBasicScenario-1457661548-project] 10.222.0.61 "GET /v2.0/ports?device_id=6b87386c-a173-427d-a5e7-e1eec028652f HTTP/1.1" status: 200 len: 210 time: 0.0291307 Nov 18 21:06:57.462015 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'name': 'network-vif-deleted', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:06:57.464489 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-77780a9c-1a8f-4271-85a3-5c0b87e8e195" -d '{"events": [{"server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "name": "network-vif-deleted", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:06:57.502603 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:06:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a4cbfe17-ad9c-4e39-87b3-014152fc25df x-openstack-request-id: req-a4cbfe17-ad9c-4e39-87b3-014152fc25df {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:06:57.502890 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6b87386c-a173-427d-a5e7-e1eec028652f", "name": "network-vif-deleted", "tag": "e439a92d-6b32-4acc-93a3-91c54d8ca660", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:06:57.503139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-a4cbfe17-ad9c-4e39-87b3-014152fc25df {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:06:57.503532 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6b87386c-a173-427d-a5e7-e1eec028652f', 'name': 'network-vif-deleted', 'tag': 'e439a92d-6b32-4acc-93a3-91c54d8ca660', 'status': 'completed', 'code': 200} Nov 18 21:06:57.919034 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:06:57.949212 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:06:57.949670 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 02f29bff-eb49-4a99-b3b4-a0a30f0a0713 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:06:58.978997 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40472) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:06:59.540388 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:59.824749 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Deleting port a615f218-b382-4149-860b-310ec91bd3fe {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:06:59.825072 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:59.925868 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] For port a615f218-b382-4149-860b-310ec91bd3fe, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=a615f218-b382-4149-860b-310ec91bd3fe,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:06:59.926265 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:06:59.940679 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Calling delete_port for a615f218-b382-4149-860b-310ec91bd3fe owned by network:router_interface {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:00.132877 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:00.162677 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Pushing event deleted for resources: {'Port': ['ID=a615f218-b382-4149-860b-310ec91bd3fe,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:00.360641 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:00.632925 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Router 95e57f35-7985-470a-b802-3cb4e75797cd has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:07:00.759484 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:07:00.769267 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] Sync routers for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:07:00.770700 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-227898cd-a92b-4bc7-8c6a-e227c1376186 admin admin] 10.222.0.61 "PUT /v2.0/routers/95e57f35-7985-470a-b802-3cb4e75797cd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7900097 Nov 18 21:07:00.773334 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40484) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:00.781598 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:07:00.782410 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:00.904961 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks [] for router, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.048747 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e439a92d-6b32-4acc-93a3-91c54d8ca660 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:01.054593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.082626 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: e439a92d-6b32-4acc-93a3-91c54d8ca660 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:01.083364 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device e439a92d-6b32-4acc-93a3-91c54d8ca660 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:01.112987 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:07:01.269238 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6489c486-9a52-4add-96e2-534b28c6db96 req-cfff63c4-0217-499e-a09d-fb0978714da7 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:01.270976 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6489c486-9a52-4add-96e2-534b28c6db96 req-cfff63c4-0217-499e-a09d-fb0978714da7 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0632331 Nov 18 21:07:01.336911 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6489c486-9a52-4add-96e2-534b28c6db96 req-bf276058-66d8-4446-bfde-aa1ef80a5beb tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0552673 Nov 18 21:07:01.383424 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170'}], 'enable_snat': True}, 'gw_port_id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:07:00Z', 'revision_number': 5, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port': {'id': 'de07cc99-a61e-40f3-bc98-cd29b32552e7', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:4f:10', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 248, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.170', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:01:54Z', 'updated_at': '2021-11-18T21:02:01Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:01.418989 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] Checking router: 95e57f35-7985-470a-b802-3cb4e75797cd for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:07:01.427617 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Deleting port de07cc99-a61e-40f3-bc98-cd29b32552e7 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:01.427951 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.431054 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] Routers {'95e57f35-7985-470a-b802-3cb4e75797cd'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:07:01.432828 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:06:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['95e57f35-7985-470a-b802-3cb4e75797cd'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:01.519072 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] Set router 95e57f35-7985-470a-b802-3cb4e75797cd gateway port host: None {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:07:01.523536 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] For port de07cc99-a61e-40f3-bc98-cd29b32552e7, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=de07cc99-a61e-40f3-bc98-cd29b32552e7,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:01.524210 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.544875 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Calling delete_port for de07cc99-a61e-40f3-bc98-cd29b32552e7 owned by network:router_gateway {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:01.585747 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:07:01Z', 'revision_number': 6, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:01.614516 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7fd31025-d26c-491b-b946-d974e55f015f None None] The sync data for ids ['95e57f35-7985-470a-b802-3cb4e75797cd'] in dv-cinder-799871-8-iscsi is: [{'id': '95e57f35-7985-470a-b802-3cb4e75797cd', 'name': 'tempest-TestMinimumBasicScenario-2067749632-router', 'tenant_id': '05d2b75b4995419da5138c25c602c16e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:01:53Z', 'updated_at': '2021-11-18T21:07:01Z', 'revision_number': 6, 'project_id': '05d2b75b4995419da5138c25c602c16e', 'gw_port_host': None}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:07:01.733458 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.762520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Pushing event deleted for resources: {'Port': ['ID=de07cc99-a61e-40f3-bc98-cd29b32552e7,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:01.802799 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:07:01.837933 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.953881 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:01.957200 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.091937 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.093021 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Fanout notify agent at l3_agent the message router_deleted on router 95e57f35-7985-470a-b802-3cb4e75797cd {{(pid=102669) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:07:02.111738 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.113164 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-d69b88cc-8a21-4776-ae0c-b5987e75717a admin admin] 10.222.0.61 "DELETE /v2.0/routers/95e57f35-7985-470a-b802-3cb4e75797cd HTTP/1.1" status: 204 len: 168 time: 1.3388345 Nov 18 21:07:02.115858 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40498) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:02.142920 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device a615f218-b382-4149-860b-310ec91bd3fe no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:02.174742 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: a615f218-b382-4149-860b-310ec91bd3fe {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:02.175353 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device a615f218-b382-4149-860b-310ec91bd3fe not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:02.199363 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-01182c14-caa4-4190-9a4a-a34a20992e60 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.210661 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Deleting subnet 15d33670-10a1-4513-bd2b-7b0b1de2e25c {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:07:02.215381 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.259063 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.453976 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.540090 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a051926-a58b-4ee2-811e-a478544dec5b req-f3468d14-a48d-4ccd-a93a-d310ad96fc8a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:02.546966 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0a051926-a58b-4ee2-811e-a478544dec5b req-f3468d14-a48d-4ccd-a93a-d310ad96fc8a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0759475 Nov 18 21:07:02.584895 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.627573 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=15d33670-10a1-4513-bd2b-7b0b1de2e25c,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:02.630416 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.636954 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-21747044-5b7c-4f74-87e7-15c4da5e266d None None] Network d912b0f3-c291-4df9-ad87-83ebffd63dae requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:07:02.638282 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-881da001-3410-472c-ae12-2ca24888eacf admin admin] 10.222.0.61 "DELETE /v2.0/subnets/15d33670-10a1-4513-bd2b-7b0b1de2e25c HTTP/1.1" status: 204 len: 168 time: 0.5207539 Nov 18 21:07:02.641766 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40506) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:02.665927 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0a051926-a58b-4ee2-811e-a478544dec5b req-406345c1-ae0e-4423-976d-4a562ba8b86c tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0837240 Nov 18 21:07:02.749295 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.831822 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Deleting port 58b6e060-0b25-4426-994f-8c58bfddfb0b {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:02.832220 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.870452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] DHCP port deletion for d912b0f3-c291-4df9-ad87-83ebffd63dae request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:07:02.912635 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] For port 58b6e060-0b25-4426-994f-8c58bfddfb0b, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=58b6e060-0b25-4426-994f-8c58bfddfb0b,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:02.913030 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:02.929529 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Calling delete_port for 58b6e060-0b25-4426-994f-8c58bfddfb0b owned by network:dhcp {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:02.960075 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Deleting port 58b6e060-0b25-4426-994f-8c58bfddfb0b {{(pid=102671) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:02.960783 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.037333 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.041045 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] For port 58b6e060-0b25-4426-994f-8c58bfddfb0b, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=58b6e060-0b25-4426-994f-8c58bfddfb0b,segment=NetworkSegment(b1433240-d17a-40eb-99a6-9242910e08a2),segment_id=b1433240-d17a-40eb-99a6-9242910e08a2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:03.042111 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.058754 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Calling delete_port for 58b6e060-0b25-4426-994f-8c58bfddfb0b owned by network:dhcp {{(pid=102671) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:03.065306 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Pushing event deleted for resources: {'Port': ['ID=58b6e060-0b25-4426-994f-8c58bfddfb0b,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:03.069348 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] No DVR routers for this DVR port 58b6e060-0b25-4426-994f-8c58bfddfb0b on host dv-cinder-799871-8-iscsi {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:07:03.176636 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.207674 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d912b0f3-c291-4df9-ad87-83ebffd63dae']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:03.223235 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b1433240-d17a-40eb-99a6-9242910e08a2') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:03.223676 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b1433240-d17a-40eb-99a6-9242910e08a2') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:03.238099 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.241858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583'] for port, after_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.255693 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.263110 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Releasing vlan 649 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:07:03.263565 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:07:03.265441 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:07:03.267819 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Pushing event deleted for resources: {'Port': ['ID=58b6e060-0b25-4426-994f-8c58bfddfb0b,revision_number=None']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:03.275450 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] No DVR routers for this DVR port 58b6e060-0b25-4426-994f-8c58bfddfb0b on host dv-cinder-799871-8-iscsi {{(pid=102671) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:07:03.279154 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.279498 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.279848 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.280212 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.280558 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.280891 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.281222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.281550 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.281881 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.282202 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.282521 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.282840 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9eb5e2d0-e440-4b99-ad31-c17cd855742c None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:03.334535 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.339732 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.343224 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] 10.222.0.61 "DELETE /v2.0/networks/d912b0f3-c291-4df9-ad87-83ebffd63dae HTTP/1.1" status: 204 len: 168 time: 0.6998117 Nov 18 21:07:03.346865 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40512) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:03.362221 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-304a737f-c7f4-4d05-956f-b32429acac2c admin admin] Pushing event deleted for resources: {'Network': ['ID=d912b0f3-c291-4df9-ad87-83ebffd63dae,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:03.842457 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39723dc2-c90b-4628-92cf-b212a6e810bc req-0fb4fd96-a689-4259-a560-f53ea11ce34a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:03.844897 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-39723dc2-c90b-4628-92cf-b212a6e810bc req-0fb4fd96-a689-4259-a560-f53ea11ce34a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0899374 Nov 18 21:07:03.850342 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:03.900631 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device de07cc99-a61e-40f3-bc98-cd29b32552e7 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:03.927396 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: de07cc99-a61e-40f3-bc98-cd29b32552e7 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:03.927749 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device de07cc99-a61e-40f3-bc98-cd29b32552e7 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:03.928196 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 58b6e060-0b25-4426-994f-8c58bfddfb0b no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:03.948941 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 58b6e060-0b25-4426-994f-8c58bfddfb0b {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:03.949353 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 58b6e060-0b25-4426-994f-8c58bfddfb0b not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:03.999151 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-39723dc2-c90b-4628-92cf-b212a6e810bc req-5794e28c-5836-4cb4-b759-be266d7623be tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1440494 Nov 18 21:07:04.183924 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Deleting port 84b73196-fb77-4c26-90a2-6d6283a3588e {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:04.184224 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:04.285623 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] For port 84b73196-fb77-4c26-90a2-6d6283a3588e, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=84b73196-fb77-4c26-90a2-6d6283a3588e,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:04.286013 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:04.300747 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Calling delete_port for 84b73196-fb77-4c26-90a2-6d6283a3588e owned by network:router_interface {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:04.530115 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:04.567517 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Pushing event deleted for resources: {'Port': ['ID=84b73196-fb77-4c26-90a2-6d6283a3588e,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:04.627542 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fe024996-072d-49ac-8c16-a4043bca2417 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:04.771430 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:05.194385 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58714c4c-57c5-45f9-bd03-2ae4bd244237 req-88e9e8aa-eba1-4683-bacc-3c21976aa1dd tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:05.197136 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-58714c4c-57c5-45f9-bd03-2ae4bd244237 req-88e9e8aa-eba1-4683-bacc-3c21976aa1dd tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0944633 Nov 18 21:07:05.276594 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-58714c4c-57c5-45f9-bd03-2ae4bd244237 req-fd3b71da-469e-49b1-b82e-1773f3a61f0d tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0687575 Nov 18 21:07:05.321373 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Router 9a562b78-48b6-4a2c-9aec-0371a3e670cf has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:07:05.486826 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:07:05.497328 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-62b0fa71-45e2-4ba3-af53-a57a5ee9436a admin admin] 10.222.0.61 "PUT /v2.0/routers/9a562b78-48b6-4a2c-9aec-0371a3e670cf/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.1444190 Nov 18 21:07:05.497328 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40542) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:05.499882 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] Sync routers for ids ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:07:05.513111 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] Routers {'9a562b78-48b6-4a2c-9aec-0371a3e670cf'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:07:05.514671 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:07:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:05.636422 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks [] for router, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:05.662985 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] Set router 9a562b78-48b6-4a2c-9aec-0371a3e670cf gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:07:05.775789 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:05.870397 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Deleting port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:05.870962 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:05.909628 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94'}], 'enable_snat': True}, 'gw_port_id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:07:04Z', 'revision_number': 5, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port': {'id': 'fc4d4a5d-7fdc-41d6-a988-f36029e6ef39', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:e9:e9:8b', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'device_owner': 'network:router_gateway', 'standard_attr_id': 288, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.94', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:08Z', 'updated_at': '2021-11-18T21:02:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:05.940587 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] Checking router: 9a562b78-48b6-4a2c-9aec-0371a3e670cf for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:07:05.950792 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] Routers {'9a562b78-48b6-4a2c-9aec-0371a3e670cf'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:07:05.951448 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:07:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:05.973666 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] For port fc4d4a5d-7fdc-41d6-a988-f36029e6ef39, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:05.974030 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:05.991118 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Calling delete_port for fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 owned by network:router_gateway {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:06.008716 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.069692 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] Set router 9a562b78-48b6-4a2c-9aec-0371a3e670cf gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:07:06.152861 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:07:05Z', 'revision_number': 6, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:06.182798 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-5dc8d116-4e13-49d4-998b-48ececc7370b None None] The sync data for ids ['9a562b78-48b6-4a2c-9aec-0371a3e670cf'] in dv-cinder-799871-8-iscsi is: [{'id': '9a562b78-48b6-4a2c-9aec-0371a3e670cf', 'name': 'tempest-TestMinimumBasicScenario-901485964-router', 'tenant_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:07Z', 'updated_at': '2021-11-18T21:07:05Z', 'revision_number': 6, 'project_id': 'a1491cc22c2d41ed8ac6b75c43e3ccc1', 'gw_port_host': None}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:07:06.201734 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.240388 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Pushing event deleted for resources: {'Port': ['ID=fc4d4a5d-7fdc-41d6-a988-f36029e6ef39,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:06.326626 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.471423 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.475393 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.565751 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34027a42-6b5b-416c-8aa1-1aeba7b94c2a req-d349dad7-d49c-4cf3-a94d-eb566a540b01 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:06.568519 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-34027a42-6b5b-416c-8aa1-1aeba7b94c2a req-d349dad7-d49c-4cf3-a94d-eb566a540b01 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.1649251 Nov 18 21:07:06.585388 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.585964 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 9a562b78-48b6-4a2c-9aec-0371a3e670cf {{(pid=102670) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:07:06.600174 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.603504 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40556) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:06.608707 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-2fde6a2b-ed33-4997-80ee-48f58763d942 admin admin] 10.222.0.61 "DELETE /v2.0/routers/9a562b78-48b6-4a2c-9aec-0371a3e670cf HTTP/1.1" status: 204 len: 168 time: 1.1025109 Nov 18 21:07:06.665770 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-34027a42-6b5b-416c-8aa1-1aeba7b94c2a req-bc129096-0e5b-44a7-b713-913ffb64425f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0868778 Nov 18 21:07:06.668877 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Deleting subnet 07eef04b-f3f6-4ee0-b23d-7f9f86f27c94 {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:07:06.672818 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.717576 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.846628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.909408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.942522 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=07eef04b-f3f6-4ee0-b23d-7f9f86f27c94,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:06.945048 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:06.948953 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/07eef04b-f3f6-4ee0-b23d-7f9f86f27c94 HTTP/1.1" status: 204 len: 168 time: 0.3434396 Nov 18 21:07:06.950454 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a32ad743-638e-4a03-906a-72b517b1b74c None None] Network 45e03d28-5c3b-481b-81f0-d332c4379a09 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:07:06.951467 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40558) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:06.955830 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.956211 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.956562 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.956902 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.957234 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.957569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.957967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.958231 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.958558 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.959267 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.959267 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:06.959489 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-deb57994-6e27-4fd1-9b63-d6c0e762d874 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:07.024778 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.081158 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Deleting port 5953e204-5211-4d54-80a6-f7d2b566b9be {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:07.081492 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.152830 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] DHCP port deletion for 45e03d28-5c3b-481b-81f0-d332c4379a09 request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:07:07.160242 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] For port 5953e204-5211-4d54-80a6-f7d2b566b9be, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=5953e204-5211-4d54-80a6-f7d2b566b9be,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:07.160613 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.174579 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Calling delete_port for 5953e204-5211-4d54-80a6-f7d2b566b9be owned by network:dhcp {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:07.204022 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] Deleting port 5953e204-5211-4d54-80a6-f7d2b566b9be {{(pid=102671) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:07:07.204427 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.264036 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.280089 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] For port 5953e204-5211-4d54-80a6-f7d2b566b9be, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=5953e204-5211-4d54-80a6-f7d2b566b9be,segment=NetworkSegment(ad897c02-8041-447c-b198-6ec5aa961ad2),segment_id=ad897c02-8041-447c-b198-6ec5aa961ad2)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:07.280590 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.281667 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] No DVR routers for this DVR port 5953e204-5211-4d54-80a6-f7d2b566b9be on host dv-cinder-799871-8-iscsi {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:07:07.296791 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] Calling delete_port for 5953e204-5211-4d54-80a6-f7d2b566b9be owned by network:dhcp {{(pid=102671) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:07:07.302945 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Pushing event deleted for resources: {'Port': ['ID=5953e204-5211-4d54-80a6-f7d2b566b9be,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:07.379833 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.387642 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583'] for port, after_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.404634 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['45e03d28-5c3b-481b-81f0-d332c4379a09']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:07.414670 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'ad897c02-8041-447c-b198-6ec5aa961ad2') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:07.414961 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'ad897c02-8041-447c-b198-6ec5aa961ad2') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:07.418219 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] Pushing event deleted for resources: {'Port': ['ID=5953e204-5211-4d54-80a6-f7d2b566b9be,revision_number=None']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:07.420094 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7efe40dc-568b-496d-af48-df2f9ccf7f8b None None] No DVR routers for this DVR port 5953e204-5211-4d54-80a6-f7d2b566b9be on host dv-cinder-799871-8-iscsi {{(pid=102671) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:07:07.425902 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.441826 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.450703 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Releasing vlan 618 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:07:07.451165 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:07:07.453103 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:07:07.464624 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.517644 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.522931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.527430 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] 10.222.0.61 "DELETE /v2.0/networks/45e03d28-5c3b-481b-81f0-d332c4379a09 HTTP/1.1" status: 204 len: 168 time: 0.5746624 Nov 18 21:07:07.543146 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b638c022-58ef-47f9-960d-110b0f5cc181 admin admin] Pushing event deleted for resources: {'Network': ['ID=45e03d28-5c3b-481b-81f0-d332c4379a09,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:07.646848 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40564) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:07.688100 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ec3c9b21-6df4-4d8e-92c3-47f0ef113c59 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=05d2b75b4995419da5138c25c602c16e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0398815 Nov 18 21:07:07.690328 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40568) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:07.746424 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fce3b43b-a0e3-474d-8423-3c481933d560 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.771315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fce3b43b-a0e3-474d-8423-3c481933d560 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.811515 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dede614-a232-4b1e-9375-fff90e8f3bc6 req-a846586d-c30f-4943-89b1-90057f6a6333 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:07.813403 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0dede614-a232-4b1e-9375-fff90e8f3bc6 req-a846586d-c30f-4943-89b1-90057f6a6333 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0620944 Nov 18 21:07:07.841605 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fce3b43b-a0e3-474d-8423-3c481933d560 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.844868 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fce3b43b-a0e3-474d-8423-3c481933d560 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:07.846517 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-fce3b43b-a0e3-474d-8423-3c481933d560 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/eb79f9a0-0320-4d56-8fdc-62bf7176a220 HTTP/1.1" status: 204 len: 168 time: 0.1552832 Nov 18 21:07:07.857504 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fce3b43b-a0e3-474d-8423-3c481933d560 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eb79f9a0-0320-4d56-8fdc-62bf7176a220,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:07.886881 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0dede614-a232-4b1e-9375-fff90e8f3bc6 req-dc728e77-5c62-4257-9452-cecec5a6f409 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0615523 Nov 18 21:07:07.899584 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 5953e204-5211-4d54-80a6-f7d2b566b9be no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:07.921633 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 5953e204-5211-4d54-80a6-f7d2b566b9be {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:07.921973 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 5953e204-5211-4d54-80a6-f7d2b566b9be not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:07.922412 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:07.942823 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:07.943179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device fc4d4a5d-7fdc-41d6-a988-f36029e6ef39 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:07.943605 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 84b73196-fb77-4c26-90a2-6d6283a3588e no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:07.963487 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 84b73196-fb77-4c26-90a2-6d6283a3588e {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:07:07.964013 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 84b73196-fb77-4c26-90a2-6d6283a3588e not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:07:08.192274 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40578) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:08.241588 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-2f6784b1-79ee-42d3-bac4-3030ab309964 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=a1491cc22c2d41ed8ac6b75c43e3ccc1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0469494 Nov 18 21:07:08.244484 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40580) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:08.249077 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:08.295802 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce23818b-7509-4b19-a05f-5f36dd0de3b9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:08.320147 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce23818b-7509-4b19-a05f-5f36dd0de3b9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:08.368869 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce23818b-7509-4b19-a05f-5f36dd0de3b9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:08.371777 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce23818b-7509-4b19-a05f-5f36dd0de3b9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:08.372994 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ce23818b-7509-4b19-a05f-5f36dd0de3b9 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1b681cc3-67e3-4580-9315-909410c4fb5f HTTP/1.1" status: 204 len: 168 time: 0.1275067 Nov 18 21:07:08.381067 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce23818b-7509-4b19-a05f-5f36dd0de3b9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1b681cc3-67e3-4580-9315-909410c4fb5f,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:09.803622 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-65ce35ca-da40-4b54-b63a-cd6630c5cb4d req-2d1b3690-8d1f-4b18-a9bc-ecc7c439ecb5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:09.805163 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-65ce35ca-da40-4b54-b63a-cd6630c5cb4d req-2d1b3690-8d1f-4b18-a9bc-ecc7c439ecb5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0530870 Nov 18 21:07:09.863655 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-65ce35ca-da40-4b54-b63a-cd6630c5cb4d req-938761f2-7a45-4953-b6e0-b853a1c35e28 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0489964 Nov 18 21:07:11.013872 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45f5283b-4d37-4e0b-a4f3-bf063c1881c6 req-a53cac4e-79b4-4abc-965f-4a66e8fd5717 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:11.016163 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45f5283b-4d37-4e0b-a4f3-bf063c1881c6 req-a53cac4e-79b4-4abc-965f-4a66e8fd5717 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0721371 Nov 18 21:07:11.077257 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45f5283b-4d37-4e0b-a4f3-bf063c1881c6 req-5ac784e7-54c6-45d0-9d66-36070e68856b tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0521653 Nov 18 21:07:12.225961 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb5debd0-e83d-41ca-afc7-8ab3ae8a77a7 req-e3127ff2-a0fd-4796-b003-855afbb740b6 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:12.227610 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cb5debd0-e83d-41ca-afc7-8ab3ae8a77a7 req-e3127ff2-a0fd-4796-b003-855afbb740b6 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0647736 Nov 18 21:07:12.294911 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cb5debd0-e83d-41ca-afc7-8ab3ae8a77a7 req-cc6b9cdc-adfb-4a66-afb4-6b8b6f0d91a3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0588915 Nov 18 21:07:13.430608 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eaf769aa-3bad-4a76-80da-5f3dba20b19d req-b7a5b6e6-5410-4ac0-8768-73f473ff3560 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:13.432883 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-eaf769aa-3bad-4a76-80da-5f3dba20b19d req-b7a5b6e6-5410-4ac0-8768-73f473ff3560 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0531585 Nov 18 21:07:13.490908 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-eaf769aa-3bad-4a76-80da-5f3dba20b19d req-f770a917-8f29-4fcd-ab5f-12a710439ecb tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0511169 Nov 18 21:07:14.644900 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0b2e3e7-013d-4f58-a05d-0f3c44f01426 req-c89effba-2840-417b-9b3b-99a44aeefe41 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:14.646621 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c0b2e3e7-013d-4f58-a05d-0f3c44f01426 req-c89effba-2840-417b-9b3b-99a44aeefe41 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0600567 Nov 18 21:07:14.713230 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c0b2e3e7-013d-4f58-a05d-0f3c44f01426 req-5080955a-7b70-464e-a608-6d92ea68d4a2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0595393 Nov 18 21:07:15.851390 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f93b9587-ebe8-4727-9427-ddf9a83f95f2 req-1a87dd5e-26ae-4dd0-853c-f7c22c5f7bd5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:15.852949 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f93b9587-ebe8-4727-9427-ddf9a83f95f2 req-1a87dd5e-26ae-4dd0-853c-f7c22c5f7bd5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0546973 Nov 18 21:07:15.912023 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f93b9587-ebe8-4727-9427-ddf9a83f95f2 req-6e32c9a0-d1ee-467c-9695-4358bd37c056 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0525713 Nov 18 21:07:16.404676 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-eddd1597-4127-4dc9-8078-352d88b097df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:16.406152 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-eddd1597-4127-4dc9-8078-352d88b097df service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1099 time: 0.0433528 Nov 18 21:07:16.513369 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-da0e0b1d-176b-4f5c-873e-9f94bda033a1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:16.514906 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-da0e0b1d-176b-4f5c-873e-9f94bda033a1 service neutron] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 910 time: 0.1015975 Nov 18 21:07:16.586417 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-e871dd99-7fc1-4e55-8afe-b9147c3fe8af service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 1002 time: 0.0642140 Nov 18 21:07:16.644993 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-7603729c-b49c-4881-9e60-852993fedbbb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:16.646562 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-7603729c-b49c-4881-9e60-852993fedbbb service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.0514851 Nov 18 21:07:16.700228 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-f0e40d5b-79ab-4f35-824f-d17d782ce898 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:16.702217 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-f0e40d5b-79ab-4f35-824f-d17d782ce898 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0461378 Nov 18 21:07:16.812155 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-40c99e8f-aef3-4649-a09c-b9f02dab21aa service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0965803 Nov 18 21:07:16.912421 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8fb95fa0-a9d8-4421-81a1-fae77b3d82c7 req-bc35e746-deaa-460a-9ab3-00cd62f0bead service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0930307 Nov 18 21:07:17.036021 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71c4b3e4-87c1-4de3-9bd2-87723a4b057f req-52461109-3068-459c-9457-715cfec45f5e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:17.037537 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-71c4b3e4-87c1-4de3-9bd2-87723a4b057f req-52461109-3068-459c-9457-715cfec45f5e tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0531528 Nov 18 21:07:17.097318 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-71c4b3e4-87c1-4de3-9bd2-87723a4b057f req-84bd4a64-044d-44b8-8421-10c549040a49 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0525508 Nov 18 21:07:18.231685 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56cc1121-9100-4cbb-a6ea-942acb23ab2c req-8e36b608-e58e-46a5-b9c3-bdfed9f3ed86 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:18.233082 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-56cc1121-9100-4cbb-a6ea-942acb23ab2c req-8e36b608-e58e-46a5-b9c3-bdfed9f3ed86 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0624239 Nov 18 21:07:18.296013 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-56cc1121-9100-4cbb-a6ea-942acb23ab2c req-2d595408-8055-4579-a50a-2b41a4b59a70 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0505550 Nov 18 21:07:19.375945 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:19.435569 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12c959a5-55b7-4af9-b838-dc2b24159703 req-a9c102a8-2a29-45bb-8a38-923c4bf831c4 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:19.436793 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-12c959a5-55b7-4af9-b838-dc2b24159703 req-a9c102a8-2a29-45bb-8a38-923c4bf831c4 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0558171 Nov 18 21:07:19.496796 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-12c959a5-55b7-4af9-b838-dc2b24159703 req-3c2763cc-d112-4a50-99ac-9a629114a0f3 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0535471 Nov 18 21:07:19.726433 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d96b813b-9878-467c-8001-f17b41fec82e req-3dc7d4dd-b046-41e8-a8b9-661bdb9d3adb tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:19.727927 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d96b813b-9878-467c-8001-f17b41fec82e req-3dc7d4dd-b046-41e8-a8b9-661bdb9d3adb tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0514336 Nov 18 21:07:19.754904 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40738) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:19.786297 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d96b813b-9878-467c-8001-f17b41fec82e req-53ac12b6-b276-470c-847b-3acf52edf3c5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0513902 Nov 18 21:07:19.846377 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-00d88319-9cb4-4b64-ba62-04a84d9c7f4f service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0900826 Nov 18 21:07:19.855614 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-93d34bbc-4589-43de-9079-64bcedbe7a08 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:07:19.856598 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-93d34bbc-4589-43de-9079-64bcedbe7a08 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0050745 Nov 18 21:07:20.208485 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40752) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:20.265740 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Deleting subnet 71e073e2-1e60-4ca4-a663-24a014f3734d {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:07:20.269748 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.306675 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.352286 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.410931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.441366 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=71e073e2-1e60-4ca4-a663-24a014f3734d,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:20.446282 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.451076 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] 10.222.0.61 "DELETE /v2.0/subnets/71e073e2-1e60-4ca4-a663-24a014f3734d HTTP/1.1" status: 204 len: 168 time: 0.2413111 Nov 18 21:07:20.454981 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 40754) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:20.458650 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.459139 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.459634 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.460122 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.460627 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.460976 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.461324 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.461643 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.461982 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.462317 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.462650 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.462975 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-72b3c88d-7ed5-4fbd-897d-f6832d1a107d admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:07:20.541511 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.622542 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.644447 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9cb58b73-7745-413b-a6b6-30673daa4d11']}} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:20.654425 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '598e0f87-4a96-43e2-99cc-de98be15abf0') {'for_net_delete': True} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:20.654718 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '598e0f87-4a96-43e2-99cc-de98be15abf0') {} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:07:20.669986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5774120'] for segment, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.685336 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.692737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Releasing vlan 627 on physical network physnet1 to pool {{(pid=102669) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:07:20.693355 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5320355'] for segment, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: Traceback (most recent call last): Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: timer() Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: cb(*args, **kw) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: return func(*args, **kwargs) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: self._notify() Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: self.callback(batched_events) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: event.method(event) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: return f(self, *a, **k) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._get(url).json() Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: return self.request(url, 'GET', **kwargs) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:07:20.696064 dv-cinder-799871-8-iscsi neutron-server[102669]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:07:20.761541 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.769036 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:20.773065 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] 10.222.0.61 "DELETE /v2.0/networks/9cb58b73-7745-413b-a6b6-30673daa4d11 HTTP/1.1" status: 204 len: 168 time: 0.3170025 Nov 18 21:07:20.788607 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3cd05106-61f2-44df-afaf-b4e2a8b1859d admin admin] Pushing event deleted for resources: {'Network': ['ID=9cb58b73-7745-413b-a6b6-30673daa4d11,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:20.926605 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9da7b762-fa31-44de-a461-2797208d508f req-1520f5b9-7133-483d-8a46-8c5ca9ad77a6 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:20.928327 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9da7b762-fa31-44de-a461-2797208d508f req-1520f5b9-7133-483d-8a46-8c5ca9ad77a6 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0596414 Nov 18 21:07:20.996409 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9da7b762-fa31-44de-a461-2797208d508f req-8b4c6c1f-a076-4240-9690-91dccd2c7462 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0589819 Nov 18 21:07:21.009433 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40764) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:21.079987 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-b8e10332-57dd-4289-a522-fcc418e17811 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=54afe6a32ce84eeca2df58c524125ab7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0691626 Nov 18 21:07:21.083842 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 40766) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:07:21.141197 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-78dd07f9-7057-4dd5-971d-7b21b221b085 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:21.163295 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-78dd07f9-7057-4dd5-971d-7b21b221b085 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:21.218365 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-78dd07f9-7057-4dd5-971d-7b21b221b085 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:21.221346 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-78dd07f9-7057-4dd5-971d-7b21b221b085 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:21.222496 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-78dd07f9-7057-4dd5-971d-7b21b221b085 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/040b98b0-a1d4-4e5e-81aa-ef1bba094812 HTTP/1.1" status: 204 len: 168 time: 0.1376932 Nov 18 21:07:21.231307 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-78dd07f9-7057-4dd5-971d-7b21b221b085 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=040b98b0-a1d4-4e5e-81aa-ef1bba094812,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:21.985996 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c9360e-bc16-47ff-9295-39294783e721 req-0a93257a-c832-498f-b2d1-be9a18aef064 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:21.987497 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-0a93257a-c832-498f-b2d1-be9a18aef064 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb&tenant_id=d0f1cb43ab064a5388db98bf6b8228fa HTTP/1.1" status: 200 len: 1099 time: 0.0460627 Nov 18 21:07:22.060299 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c9360e-bc16-47ff-9295-39294783e721 req-0d32ec02-9bd4-4859-94fa-f598b4b182b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:22.061822 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-0d32ec02-9bd4-4859-94fa-f598b4b182b7 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1099 time: 0.0442531 Nov 18 21:07:22.185597 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecceeb44-ba80-45e1-9dbe-dec88e270a6b req-c305135a-8fa4-4149-aaf2-40780a4c2682 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:22.187138 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ecceeb44-ba80-45e1-9dbe-dec88e270a6b req-c305135a-8fa4-4149-aaf2-40780a4c2682 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.1096177 Nov 18 21:07:22.215303 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c9360e-bc16-47ff-9295-39294783e721 req-f8c0bec0-d50e-4af6-a4bf-5d78cf9e84b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:22.216822 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-f8c0bec0-d50e-4af6-a4bf-5d78cf9e84b4 service neutron] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 910 time: 0.1477046 Nov 18 21:07:22.297390 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ecceeb44-ba80-45e1-9dbe-dec88e270a6b req-b4b5938a-ed91-4dd9-aa3f-4f9d36437c27 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1039641 Nov 18 21:07:22.313446 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-2d3589a7-fc2e-4ab6-ad43-cd911e33a6c9 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 1002 time: 0.0881474 Nov 18 21:07:22.336150 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4aff6212-9663-463b-8fe1-7ffeaf22133e req-e006de9d-288f-44c0-b114-8c614c928b4b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:22.337720 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4aff6212-9663-463b-8fe1-7ffeaf22133e req-e006de9d-288f-44c0-b114-8c614c928b4b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0552731 Nov 18 21:07:22.384997 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c9360e-bc16-47ff-9295-39294783e721 req-72ccb47d-70b7-4dfa-aa8b-a42f0ceeb226 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:22.387706 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-72ccb47d-70b7-4dfa-aa8b-a42f0ceeb226 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.0537891 Nov 18 21:07:22.401151 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4aff6212-9663-463b-8fe1-7ffeaf22133e req-cd7b2fc9-423a-4521-8638-d9006c9fe61b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500751 Nov 18 21:07:22.443585 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66c9360e-bc16-47ff-9295-39294783e721 req-45a37b79-2d5d-42e5-9a04-2e4d5a0df177 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:22.445576 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-45a37b79-2d5d-42e5-9a04-2e4d5a0df177 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0485482 Nov 18 21:07:22.547726 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-18db4a0d-f4f0-4e68-adb0-c1522991cadc service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0904734 Nov 18 21:07:22.645872 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66c9360e-bc16-47ff-9295-39294783e721 req-347058c2-e930-48ca-ac63-79b92ee8737f service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0882952 Nov 18 21:07:22.751769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:22.851241 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:22.876318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:07:22.878556 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-bf6f0319-094e-45ab-9328-7539ad03b95f" -d '{"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-unplugged", "status": "completed", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:07:22.891965 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:22.896768 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:22.931235 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 18 Nov 2021 21:07:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-746f9ca0-ad63-4fac-9014-df6ee113fafc x-openstack-request-id: req-746f9ca0-ad63-4fac-9014-df6ee113fafc {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:07:22.931542 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-unplugged", "status": "completed", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:07:22.931806 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-746f9ca0-ad63-4fac-9014-df6ee113fafc {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:07:22.932236 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'code': 200} Nov 18 21:07:22.953824 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=6']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:23.422910 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3d81e187-4088-4568-9c24-99f98e1dd0c6 req-4820691d-00ed-45c8-b5eb-211dc596e82c tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:23.424414 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3d81e187-4088-4568-9c24-99f98e1dd0c6 req-4820691d-00ed-45c8-b5eb-211dc596e82c tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0514057 Nov 18 21:07:23.478727 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3d81e187-4088-4568-9c24-99f98e1dd0c6 req-f3ffb07f-fb82-415d-a18e-fc2a76d34ea8 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0477862 Nov 18 21:07:23.549311 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e92dd9cd-2349-4975-941b-c77ee39ec5cf req-075bfd41-e5bd-4156-ab14-47220d87e3e1 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:23.551199 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e92dd9cd-2349-4975-941b-c77ee39ec5cf req-075bfd41-e5bd-4156-ab14-47220d87e3e1 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0645294 Nov 18 21:07:23.601460 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e92dd9cd-2349-4975-941b-c77ee39ec5cf req-71edd52d-7929-481b-9240-022c143fdf25 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439496 Nov 18 21:07:24.601991 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23d46956-51b6-4193-bc11-1b7e46748284 req-a42f774b-8dc3-421e-919a-23056a7d6a0c tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:24.603447 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-23d46956-51b6-4193-bc11-1b7e46748284 req-a42f774b-8dc3-421e-919a-23056a7d6a0c tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0508919 Nov 18 21:07:24.657330 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-23d46956-51b6-4193-bc11-1b7e46748284 req-826f9aeb-7bce-4873-9966-74d315123b20 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0472226 Nov 18 21:07:24.733626 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a9799b7-e92a-4dfb-87c4-3cdc38546668 req-4acd77ff-7dd2-4adb-9f61-367452775de0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:24.735098 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6a9799b7-e92a-4dfb-87c4-3cdc38546668 req-4acd77ff-7dd2-4adb-9f61-367452775de0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0606391 Nov 18 21:07:24.788864 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6a9799b7-e92a-4dfb-87c4-3cdc38546668 req-75fcf2b8-46aa-472d-bb93-6a18fd56d304 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475748 Nov 18 21:07:25.779069 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c5bd113-d9cc-44c7-aaa1-ea6db30014ee req-9edc1dcc-b79c-41ff-b021-bfbdbeb81436 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:25.780573 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6c5bd113-d9cc-44c7-aaa1-ea6db30014ee req-9edc1dcc-b79c-41ff-b021-bfbdbeb81436 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0536087 Nov 18 21:07:25.834192 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6c5bd113-d9cc-44c7-aaa1-ea6db30014ee req-8719069f-ba1b-47b2-a534-c6c475889751 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0474691 Nov 18 21:07:25.914235 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-effe3e30-48e9-473f-8716-07c6df6e1f77 req-9a09b13b-293e-4e00-8e93-1ec127fcbccb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:25.915719 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-effe3e30-48e9-473f-8716-07c6df6e1f77 req-9a09b13b-293e-4e00-8e93-1ec127fcbccb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0531299 Nov 18 21:07:25.964751 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-effe3e30-48e9-473f-8716-07c6df6e1f77 req-73f5b24a-5686-478e-bf52-77e04d0fe4e9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415475 Nov 18 21:07:26.952961 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e01a7bd-191a-4c5e-9547-9343329ff238 req-fc032c97-f9cc-4911-8e52-90af4b7a9274 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:26.954447 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e01a7bd-191a-4c5e-9547-9343329ff238 req-fc032c97-f9cc-4911-8e52-90af4b7a9274 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0494800 Nov 18 21:07:27.007478 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e01a7bd-191a-4c5e-9547-9343329ff238 req-784d8af6-4866-4cd6-8048-f8badcf8c571 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0465724 Nov 18 21:07:27.092601 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fc77cb5-951e-401a-b99b-f4726ae3c6c8 req-155c26e2-1458-4695-a8fd-78671963c2ef tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:27.094007 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1fc77cb5-951e-401a-b99b-f4726ae3c6c8 req-155c26e2-1458-4695-a8fd-78671963c2ef tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0538459 Nov 18 21:07:27.141842 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1fc77cb5-951e-401a-b99b-f4726ae3c6c8 req-8aa0bb1a-9e72-4b41-967f-590103e079cd tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0416639 Nov 18 21:07:28.129991 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-980004a4-f234-4f82-b3bf-94f849b7cc8e req-6dbe7b85-a1b5-4cee-91a0-34a59e42f36b tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:28.131631 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-980004a4-f234-4f82-b3bf-94f849b7cc8e req-6dbe7b85-a1b5-4cee-91a0-34a59e42f36b tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0505941 Nov 18 21:07:28.181706 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-980004a4-f234-4f82-b3bf-94f849b7cc8e req-5bd04451-6b32-46c6-9b11-9129ac9701a5 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0435681 Nov 18 21:07:28.270898 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-683d36cb-7920-4f1f-8a00-1966f6af2adf req-63b7643a-d327-411f-9e24-0d6cdb38301f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:28.272400 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-683d36cb-7920-4f1f-8a00-1966f6af2adf req-63b7643a-d327-411f-9e24-0d6cdb38301f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0546558 Nov 18 21:07:28.322833 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-683d36cb-7920-4f1f-8a00-1966f6af2adf req-e58e09d9-43d7-4675-a908-5561705e8c0a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437226 Nov 18 21:07:28.882183 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-668eedbe-0808-4e7c-b4bf-a8cd239bb451 req-63ba5b0c-da2c-4a52-87c9-f7abff3cca48 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:28.883698 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-668eedbe-0808-4e7c-b4bf-a8cd239bb451 req-63ba5b0c-da2c-4a52-87c9-f7abff3cca48 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1097 time: 0.0407734 Nov 18 21:07:28.934698 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-668eedbe-0808-4e7c-b4bf-a8cd239bb451 req-1ddb438a-2558-4a98-946d-a51bdfa5ea16 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0419550 Nov 18 21:07:29.308443 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f71d2c6a-2a5c-48eb-9717-2861b180f549 req-888e0203-8b8e-4487-bb54-07e8caa8540b tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:29.310117 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f71d2c6a-2a5c-48eb-9717-2861b180f549 req-888e0203-8b8e-4487-bb54-07e8caa8540b tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0516646 Nov 18 21:07:29.361998 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f71d2c6a-2a5c-48eb-9717-2861b180f549 req-0ffa3ae5-136d-4392-9c47-c42ad61a5e71 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0458214 Nov 18 21:07:29.459807 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16c9a4b4-75aa-4648-857d-1165272e470a req-65ea88da-2bdf-4fa8-95c7-85c2849436ae tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:29.461307 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16c9a4b4-75aa-4648-857d-1165272e470a req-65ea88da-2bdf-4fa8-95c7-85c2849436ae tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0565131 Nov 18 21:07:29.517638 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16c9a4b4-75aa-4648-857d-1165272e470a req-4877cd11-c8d4-4d90-b831-f8b4d7e414ec tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0498285 Nov 18 21:07:30.479141 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c98f756f-7145-4399-8ef6-3610eaea3393 req-4037b0cb-d520-481b-9cf6-75219a5e81bf tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:30.480920 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c98f756f-7145-4399-8ef6-3610eaea3393 req-4037b0cb-d520-481b-9cf6-75219a5e81bf tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 944 time: 0.0500269 Nov 18 21:07:30.529936 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c98f756f-7145-4399-8ef6-3610eaea3393 req-18fae5d6-a589-4528-addb-639f44c26cdd tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0430715 Nov 18 21:07:30.639142 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74d206e9-6173-4930-b4b2-b50c670affdb req-20602766-0c55-4a9a-b88b-adcecfaa050b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:30.640669 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-74d206e9-6173-4930-b4b2-b50c670affdb req-20602766-0c55-4a9a-b88b-adcecfaa050b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0504210 Nov 18 21:07:30.696946 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-74d206e9-6173-4930-b4b2-b50c670affdb req-d34401a0-5b5c-4dd6-a6d6-276632e5a1a8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502262 Nov 18 21:07:30.788560 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:07:30.888078 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:30.900630 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'port_id': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'mac_address': 'fa:16:3e:e3:7b:9a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 637, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:07:30.941403 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:30.962076 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:07:30.983329 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:30.987740 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:31.048359 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=7']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:31.273872 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:07:31.834167 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d945e1f-9c2b-402b-96eb-460e3bc0aa42 req-445b9b01-2d4c-4540-a82f-7cb0aeb954fc tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:31.835817 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8d945e1f-9c2b-402b-96eb-460e3bc0aa42 req-445b9b01-2d4c-4540-a82f-7cb0aeb954fc tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0542634 Nov 18 21:07:31.892063 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8d945e1f-9c2b-402b-96eb-460e3bc0aa42 req-e86b9e7c-1e53-4c71-a0d9-e8be68ee99db tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0493307 Nov 18 21:07:32.193582 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6007938f-0f07-46cd-b691-0bed0173fdee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:32.814851 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:07:32.870532 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:07:32.871035 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:32.988293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:33.031102 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:07:33.034166 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a967dc79-b98d-4a91-ae1a-7ad060b483a9" -d '{"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-plugged", "status": "completed", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:07:33.051832 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:33.059327 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:33.080441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2873ea54-b7f8-4a59-8f69-0df838b4b8b4 req-88e1c595-a6e0-4f3a-a221-208c9a2f2f45 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:33.090543 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2873ea54-b7f8-4a59-8f69-0df838b4b8b4 req-88e1c595-a6e0-4f3a-a221-208c9a2f2f45 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0836396 Nov 18 21:07:33.110867 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d990f79b-33e1-4fdb-9b25-718ff3087639 req-b5faa859-fd51-4edb-bc96-2fbe245d1c9f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:33.112657 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d990f79b-33e1-4fdb-9b25-718ff3087639 req-b5faa859-fd51-4edb-bc96-2fbe245d1c9f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0598042 Nov 18 21:07:33.117868 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=8']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:33.142251 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2873ea54-b7f8-4a59-8f69-0df838b4b8b4 req-e797bf56-c75c-45d8-bdbd-45402dd64a86 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503531 Nov 18 21:07:33.191613 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:07:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9fdbecd6-0888-4e7f-974c-d3457d7757e3 x-openstack-request-id: req-9fdbecd6-0888-4e7f-974c-d3457d7757e3 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:07:33.192143 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-plugged", "status": "completed", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:07:33.192567 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-9fdbecd6-0888-4e7f-974c-d3457d7757e3 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:07:33.193133 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'code': 200} Nov 18 21:07:33.202385 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d990f79b-33e1-4fdb-9b25-718ff3087639 req-a24fd36e-f1eb-41a5-802d-f35a8908133f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0806553 Nov 18 21:07:34.288967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17d9bd61-3eeb-489c-b91e-ad938bf4ce1e req-1f926a02-6af3-40b0-85bf-e9cdbbdbfd94 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:34.290829 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-17d9bd61-3eeb-489c-b91e-ad938bf4ce1e req-1f926a02-6af3-40b0-85bf-e9cdbbdbfd94 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0643687 Nov 18 21:07:34.347529 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-17d9bd61-3eeb-489c-b91e-ad938bf4ce1e req-68bc1d08-cc50-4c3c-a46b-417f782d3df2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0491300 Nov 18 21:07:34.362966 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54fb100b-cc4c-4ba7-b950-4a76a454c8fb req-c1d9a724-a2fb-416b-90a5-07d55dfe844b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:34.365487 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-54fb100b-cc4c-4ba7-b950-4a76a454c8fb req-c1d9a724-a2fb-416b-90a5-07d55dfe844b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0624745 Nov 18 21:07:34.425519 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-54fb100b-cc4c-4ba7-b950-4a76a454c8fb req-edcca8b4-d1a3-499d-923e-250e1c03d001 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482802 Nov 18 21:07:34.622754 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-5a872736-6534-4641-8b2d-68d694abb2f2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:35.466594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e21428b-b507-4799-be59-724faac190bf req-7191d037-3d53-4d8c-874f-3193672e62ff tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:35.468176 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2e21428b-b507-4799-be59-724faac190bf req-7191d037-3d53-4d8c-874f-3193672e62ff tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0503619 Nov 18 21:07:35.529243 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2e21428b-b507-4799-be59-724faac190bf req-e08b16b1-0bec-41cf-8f8c-0d0c14d51452 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541086 Nov 18 21:07:35.558879 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe3c5bb6-d6a9-4a8a-8931-02d0b41e7122 req-359f9b08-58c6-44e1-b3a1-85370e4911bb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:35.560363 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fe3c5bb6-d6a9-4a8a-8931-02d0b41e7122 req-359f9b08-58c6-44e1-b3a1-85370e4911bb tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0569241 Nov 18 21:07:35.607921 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fe3c5bb6-d6a9-4a8a-8931-02d0b41e7122 req-68022155-3591-44fd-98c6-dc39696cceec tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415077 Nov 18 21:07:36.006548 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:36.675517 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b668236-c58b-489c-80ed-4ae937d96484 req-24ca8b47-2e38-48fe-9dac-0519449d572a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:36.678542 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2b668236-c58b-489c-80ed-4ae937d96484 req-24ca8b47-2e38-48fe-9dac-0519449d572a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0569477 Nov 18 21:07:36.738346 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-2b668236-c58b-489c-80ed-4ae937d96484 req-25052e97-b34a-4c5f-8d25-6bfb61087821 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0519631 Nov 18 21:07:36.761404 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68c81b06-f364-42c3-add7-f744bc3673be req-3f7f00d6-5545-4e9d-9e84-0163d22aa770 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:36.763472 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-68c81b06-f364-42c3-add7-f744bc3673be req-3f7f00d6-5545-4e9d-9e84-0163d22aa770 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0658376 Nov 18 21:07:36.829467 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-68c81b06-f364-42c3-add7-f744bc3673be req-6a701ddf-a2b9-4334-87f7-c26100ddc5ab tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0597966 Nov 18 21:07:37.471581 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:37.863331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f27381e1-db12-44aa-958b-22df062bb1be req-898f98fb-03ce-49e2-9d61-1fa03f6c4cc7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:37.864851 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f27381e1-db12-44aa-958b-22df062bb1be req-898f98fb-03ce-49e2-9d61-1fa03f6c4cc7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0555804 Nov 18 21:07:37.919232 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f27381e1-db12-44aa-958b-22df062bb1be req-46d1de6c-fc10-4c18-9a9e-4fe83fe2cfa2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452960 Nov 18 21:07:37.962106 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f814ff7f-e485-461d-8799-3f4fde3d1c7f req-20ee76d5-9d3a-42f0-a43f-f81fd111dc71 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:37.964381 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f814ff7f-e485-461d-8799-3f4fde3d1c7f req-20ee76d5-9d3a-42f0-a43f-f81fd111dc71 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0517178 Nov 18 21:07:38.016185 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f814ff7f-e485-461d-8799-3f4fde3d1c7f req-4b6a710b-08db-4974-a91e-7a61346fcbc7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0458126 Nov 18 21:07:38.246798 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:38.801930 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:07:39.042521 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b4751cc-1874-4662-a104-35de9d964632 req-fea126da-ff2a-44f4-9d07-d6de187a538c tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:39.043992 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9b4751cc-1874-4662-a104-35de9d964632 req-fea126da-ff2a-44f4-9d07-d6de187a538c tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0499632 Nov 18 21:07:39.093296 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9b4751cc-1874-4662-a104-35de9d964632 req-4a88056a-6de5-4db5-885a-faae755870a0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0434172 Nov 18 21:07:39.133825 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a7018b4-7d61-4572-b59f-a33a559ddbdd req-c305323c-a5b2-4084-80c5-ff1c706603ff tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:39.135840 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a7018b4-7d61-4572-b59f-a33a559ddbdd req-c305323c-a5b2-4084-80c5-ff1c706603ff tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0487671 Nov 18 21:07:39.182572 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3a7018b4-7d61-4572-b59f-a33a559ddbdd req-0ff5a53c-f32f-4f6e-9427-6e56937b33ea tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0407097 Nov 18 21:07:40.215257 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33ea37bd-ca32-420e-a7e7-d44096bc798a req-1f921733-b441-4429-9f11-c6df7e699014 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:40.216294 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-33ea37bd-ca32-420e-a7e7-d44096bc798a req-1f921733-b441-4429-9f11-c6df7e699014 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0537646 Nov 18 21:07:40.281762 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-33ea37bd-ca32-420e-a7e7-d44096bc798a req-b3368242-9351-44e1-a957-ad477649e69d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0584114 Nov 18 21:07:40.312145 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-675347dc-606a-4bba-afee-6badfc57d8e9 req-42e768c7-bf56-465c-a37c-f2b079280b3c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:40.313748 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-675347dc-606a-4bba-afee-6badfc57d8e9 req-42e768c7-bf56-465c-a37c-f2b079280b3c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0567465 Nov 18 21:07:40.369321 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-675347dc-606a-4bba-afee-6badfc57d8e9 req-556da7dd-0e62-4393-994a-c98696ce2427 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0495114 Nov 18 21:07:41.415673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26830b4a-d82d-45bd-a01f-782e0395fafa req-55b82a2f-9269-4b0c-ae4f-6718172d2efb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:41.417948 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-26830b4a-d82d-45bd-a01f-782e0395fafa req-55b82a2f-9269-4b0c-ae4f-6718172d2efb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0589309 Nov 18 21:07:41.476870 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-26830b4a-d82d-45bd-a01f-782e0395fafa req-65b774c3-eabe-44d7-9d97-41920bc6b204 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0499766 Nov 18 21:07:41.515260 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f82643e-39d4-4225-b37d-2c1a84337a56 req-b5e6a303-301f-4457-9159-afd1e86c96db tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:41.517427 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3f82643e-39d4-4225-b37d-2c1a84337a56 req-b5e6a303-301f-4457-9159-afd1e86c96db tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0713449 Nov 18 21:07:41.570539 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3f82643e-39d4-4225-b37d-2c1a84337a56 req-87a2ab95-127e-451e-8813-71595c1003e2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0469775 Nov 18 21:07:42.604940 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b7f60f6-0a49-4542-a280-05afb4d840a6 req-ab6a4d80-6ee3-4e28-b53f-dd5ad6b14b03 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:42.606909 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1b7f60f6-0a49-4542-a280-05afb4d840a6 req-ab6a4d80-6ee3-4e28-b53f-dd5ad6b14b03 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0572336 Nov 18 21:07:42.662690 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1b7f60f6-0a49-4542-a280-05afb4d840a6 req-66d8cd4d-98dd-4f65-883f-b2c86263b50a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490723 Nov 18 21:07:42.699954 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1e52e96-34e6-4eb4-b106-3a3f723c2bfc req-6d42e5b0-7141-48e9-9748-81cf41a9c585 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:42.701497 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c1e52e96-34e6-4eb4-b106-3a3f723c2bfc req-6d42e5b0-7141-48e9-9748-81cf41a9c585 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0534303 Nov 18 21:07:42.749441 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c1e52e96-34e6-4eb4-b106-3a3f723c2bfc req-98d31108-5fbb-4cf0-bd13-009d0504a9a4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419352 Nov 18 21:07:43.795587 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5b9c334-7ff4-4b7f-9803-1bd6b2beb81d req-68c44ad6-736d-41bd-bd62-bc99052c8dbb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:43.797394 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b5b9c334-7ff4-4b7f-9803-1bd6b2beb81d req-68c44ad6-736d-41bd-bd62-bc99052c8dbb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0590611 Nov 18 21:07:43.858200 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b5b9c334-7ff4-4b7f-9803-1bd6b2beb81d req-89ea424d-6c1b-4deb-9e19-5f4fffe689e5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0532618 Nov 18 21:07:43.924270 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-711cc270-dcfa-4be3-9a37-b8039e3e600e req-110fcb8f-1936-4b87-9bf7-ce986723aa81 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:43.926666 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-711cc270-dcfa-4be3-9a37-b8039e3e600e req-110fcb8f-1936-4b87-9bf7-ce986723aa81 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0601280 Nov 18 21:07:43.983271 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-711cc270-dcfa-4be3-9a37-b8039e3e600e req-41a71401-b525-43ab-b8cc-8452e4c62944 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482914 Nov 18 21:07:44.129877 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-326310fa-6ba3-4f54-856d-ada9505336d9 req-1ace27dc-3eec-48d8-a4d7-8b1304d54f6b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:44.131480 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-326310fa-6ba3-4f54-856d-ada9505336d9 req-1ace27dc-3eec-48d8-a4d7-8b1304d54f6b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0684667 Nov 18 21:07:44.195355 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-326310fa-6ba3-4f54-856d-ada9505336d9 req-d4d1d42d-94b0-42bf-8503-e9fac662cdf4 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0554171 Nov 18 21:07:44.202694 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-ea333c62-fe06-48c7-93b4-2cac926b87b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:44.205137 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-ea333c62-fe06-48c7-93b4-2cac926b87b2 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1099 time: 0.0539455 Nov 18 21:07:44.329876 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-a74fe79d-b429-44b7-a7d0-0194b7b64a98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:44.331504 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-a74fe79d-b429-44b7-a7d0-0194b7b64a98 service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.1137118 Nov 18 21:07:44.414171 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-b01e11ff-64bb-4092-b1f9-5fa86828f81d service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 1001 time: 0.0683072 Nov 18 21:07:44.467665 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-52a9d703-4602-414a-8a2c-92aec6d2a70c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:44.469060 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-52a9d703-4602-414a-8a2c-92aec6d2a70c service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0462875 Nov 18 21:07:44.536305 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-8888dc4f-c847-4fa8-aeca-e3c4f2799fa3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:44.537851 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-8888dc4f-c847-4fa8-aeca-e3c4f2799fa3 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0601068 Nov 18 21:07:44.639059 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-d87c6240-5326-405f-bafb-b415125144ee service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918965 Nov 18 21:07:44.748472 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-43f2fb9d-5f99-4fa1-924f-a99fffaa9cc9 req-ee07a79b-c001-4222-8108-eceb05a8cc25 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0977273 Nov 18 21:07:44.860699 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:07:44.991198 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:45.003997 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'mac_address': 'fa:16:3e:f9:cd:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:07:45.052320 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:45.079517 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id 4dae9221-3452-4f87-b4f2-0cdad7652d8c {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:07:45.113380 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:45.118436 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:45.161431 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-306ead63-b9de-4dea-9d57-af00693b6dfa req-9373899c-15cd-42c9-b703-f466b8e149a8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:45.164209 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-306ead63-b9de-4dea-9d57-af00693b6dfa req-9373899c-15cd-42c9-b703-f466b8e149a8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0769615 Nov 18 21:07:45.181880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=6']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:45.227120 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-306ead63-b9de-4dea-9d57-af00693b6dfa req-1484671a-1dde-4e04-af74-fc400e5f20fe tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541897 Nov 18 21:07:45.297022 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['4dae9221-3452-4f87-b4f2-0cdad7652d8c'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:07:45.329786 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7dd8466b-720d-43e9-9d4c-a908e7f8cc64 req-8f9d09ff-d846-42e0-a5d4-577eda2eb908 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:45.331604 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7dd8466b-720d-43e9-9d4c-a908e7f8cc64 req-8f9d09ff-d846-42e0-a5d4-577eda2eb908 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0533257 Nov 18 21:07:45.391824 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7dd8466b-720d-43e9-9d4c-a908e7f8cc64 req-cb93ab33-e36f-444c-95a4-f3068d20d26b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537875 Nov 18 21:07:46.382949 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88b3c8ce-6061-4a88-a6ad-9b7e924fda6c req-93802296-c99e-4f9c-bf4e-cdcbf9de10e8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:46.388666 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b3c8ce-6061-4a88-a6ad-9b7e924fda6c req-93802296-c99e-4f9c-bf4e-cdcbf9de10e8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 944 time: 0.0705779 Nov 18 21:07:46.455405 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-88b3c8ce-6061-4a88-a6ad-9b7e924fda6c req-77d96470-fe1a-4f4a-b9e8-232dd089c54d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0594280 Nov 18 21:07:46.542718 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d94d5388-2658-4134-a1ff-bbdb91291d42 req-fd59c2f7-6bb2-4ba0-b9b9-11d876db21a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:46.551565 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d94d5388-2658-4134-a1ff-bbdb91291d42 req-fd59c2f7-6bb2-4ba0-b9b9-11d876db21a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0636773 Nov 18 21:07:46.604315 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d94d5388-2658-4134-a1ff-bbdb91291d42 req-b9cfa87f-e774-4e53-9731-c8cc987b818f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0512941 Nov 18 21:07:46.878467 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:07:46.942039 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 4dae9221-3452-4f87-b4f2-0cdad7652d8c triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:07:46.942413 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:47.193534 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:47.223227 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:07:47.225660 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5420ec90-9465-4796-8c23-b284f2793c4b" -d '{"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-plugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:07:47.241895 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:47.248512 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:47.301138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:07:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d3d65a32-25ac-4c5d-bb4f-1396b6453600 x-openstack-request-id: req-d3d65a32-25ac-4c5d-bb4f-1396b6453600 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:07:47.301138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-plugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:07:47.302116 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d3d65a32-25ac-4c5d-bb4f-1396b6453600 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:07:47.302367 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'code': 200} Nov 18 21:07:47.306947 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=7']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:07:47.617403 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c9b3ae7-198f-4bc5-9533-f509ddf4a266 req-8fe6da3d-b998-4830-9029-5e4caead221d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:47.618958 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3c9b3ae7-198f-4bc5-9533-f509ddf4a266 req-8fe6da3d-b998-4830-9029-5e4caead221d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0555472 Nov 18 21:07:47.684202 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3c9b3ae7-198f-4bc5-9533-f509ddf4a266 req-3830f8ae-2167-4bfa-8f30-2378c6cd45ea tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0509696 Nov 18 21:07:48.849305 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7c9afd0-5784-482e-8edc-0299a73507a7 req-fba803b6-3ce1-49cb-97ba-f57290ccbdb2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:48.851257 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a7c9afd0-5784-482e-8edc-0299a73507a7 req-fba803b6-3ce1-49cb-97ba-f57290ccbdb2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0612957 Nov 18 21:07:48.912501 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a7c9afd0-5784-482e-8edc-0299a73507a7 req-168a3580-0531-4440-9b15-f215b1d8e15c tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0535965 Nov 18 21:07:49.391281 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:50.063716 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22996556-a314-493b-b7e4-a93369f68cb3 req-17aafa38-fe28-400c-a68d-542568ea0256 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:50.065496 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-22996556-a314-493b-b7e4-a93369f68cb3 req-17aafa38-fe28-400c-a68d-542568ea0256 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0655520 Nov 18 21:07:50.137338 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-22996556-a314-493b-b7e4-a93369f68cb3 req-f52adda6-cb80-45bc-85d6-88709e513192 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0606921 Nov 18 21:07:51.281642 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad9cc6f3-470e-4a19-9092-2a848e4de119 req-c6072d5b-62e2-4a40-814b-6f6a6cd744c3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:51.283206 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ad9cc6f3-470e-4a19-9092-2a848e4de119 req-c6072d5b-62e2-4a40-814b-6f6a6cd744c3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0602565 Nov 18 21:07:51.348472 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ad9cc6f3-470e-4a19-9092-2a848e4de119 req-1c830529-379b-4883-a6ce-cdcf0d7082e9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0588262 Nov 18 21:07:52.565429 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-deb87ae8-911f-4397-a0a8-cdf08b180603 req-83e9bd3a-26f4-46d5-a9f0-a780482a094f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:52.572001 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-deb87ae8-911f-4397-a0a8-cdf08b180603 req-83e9bd3a-26f4-46d5-a9f0-a780482a094f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0947485 Nov 18 21:07:52.624760 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-deb87ae8-911f-4397-a0a8-cdf08b180603 req-e8cdb24d-2d29-43d2-b45d-dea643717ecc tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518105 Nov 18 21:07:53.750242 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-c8cf8140-52f2-42f6-bffb-e6ab2ade0a94 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0635729 Nov 18 21:07:53.790848 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0094252-6017-47a4-bccf-c0cf8b2f7180 req-14c5a387-ed2b-4fa1-9991-afd8c6a3afc5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:53.792590 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f0094252-6017-47a4-bccf-c0cf8b2f7180 req-14c5a387-ed2b-4fa1-9991-afd8c6a3afc5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0564454 Nov 18 21:07:53.911539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-cc13fb7d-1b40-439f-8d4f-89dea67dbb02 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:53.913218 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-cc13fb7d-1b40-439f-8d4f-89dea67dbb02 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1099 time: 0.1196239 Nov 18 21:07:53.939775 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f0094252-6017-47a4-bccf-c0cf8b2f7180 req-55d4e9fc-91fd-4e6b-bd48-8d212ecfd2b7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1341331 Nov 18 21:07:54.086465 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-aaaf601c-5d7f-4d58-aec8-cde0755af789 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:54.089245 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-aaaf601c-5d7f-4d58-aec8-cde0755af789 service neutron] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 910 time: 0.1421454 Nov 18 21:07:54.179805 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-3b6207f9-375d-43b0-8c96-a3bd66aca0f9 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 1002 time: 0.0760939 Nov 18 21:07:54.260599 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-b619fa18-ddf2-42f1-8bc9-45e583dc1cc9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:54.263916 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-b619fa18-ddf2-42f1-8bc9-45e583dc1cc9 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.0731125 Nov 18 21:07:54.337394 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-0c771a9a-459d-49ae-be2f-04abef4cab76 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:54.344214 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-0c771a9a-459d-49ae-be2f-04abef4cab76 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0655060 Nov 18 21:07:54.459570 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-ad53e81f-8195-4e83-b4c0-b5c9e9fc4c39 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1089265 Nov 18 21:07:54.632345 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4c9e836b-eada-41c4-b793-2ca5e0f6b907 req-283b119e-9c0f-43cc-bd93-662bd9bb5970 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1515131 Nov 18 21:07:55.136444 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fde957e0-e4a7-4069-8ae7-159c6f6b0bcc req-0bf43c09-9019-47f9-a0b9-1677b9a00377 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:55.138020 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fde957e0-e4a7-4069-8ae7-159c6f6b0bcc req-0bf43c09-9019-47f9-a0b9-1677b9a00377 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0765004 Nov 18 21:07:55.234081 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-fde957e0-e4a7-4069-8ae7-159c6f6b0bcc req-8e069ce5-76c3-444c-82bb-7ee3863542b7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0860069 Nov 18 21:07:56.369827 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d92df56-bb8a-4a04-b155-fa89be696311 req-a72530d1-76c7-4a00-be95-fa86d09b089d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:56.371494 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0d92df56-bb8a-4a04-b155-fa89be696311 req-a72530d1-76c7-4a00-be95-fa86d09b089d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0572231 Nov 18 21:07:56.450849 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0d92df56-bb8a-4a04-b155-fa89be696311 req-6469d61c-b4d5-45a8-b9dc-781651ff8ec7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0706940 Nov 18 21:07:56.459101 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-62a7f1b9-9900-46e3-9467-78f2243aa7a7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:56.460736 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-62a7f1b9-9900-46e3-9467-78f2243aa7a7 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1098 time: 0.0788188 Nov 18 21:07:56.565161 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-594ebdf9-12d1-4869-907f-66e2a2d87e1d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:56.566741 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-594ebdf9-12d1-4869-907f-66e2a2d87e1d service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.0942254 Nov 18 21:07:56.642381 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-5155eaaa-47a4-461c-8130-3d1649cae263 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 200 len: 1000 time: 0.0678477 Nov 18 21:07:56.698539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-76261613-632d-45f5-b5e7-4021e6f4dfea service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:56.700004 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-76261613-632d-45f5-b5e7-4021e6f4dfea service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0503178 Nov 18 21:07:56.748970 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-ee8e73b4-5c4a-46e9-b8ae-5c227454c3b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:56.750461 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-ee8e73b4-5c4a-46e9-b8ae-5c227454c3b4 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0432463 Nov 18 21:07:56.846235 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-4b0b8da7-a07e-4df9-84a6-4186f31c8595 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876238 Nov 18 21:07:56.949934 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-298fce23-4ce8-4626-8867-0b9403f984d8 req-9b56b86f-ca16-4346-8f3d-46d6cb39ce9c service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921674 Nov 18 21:07:57.591140 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b606df3-18e1-4d95-a14d-c2d6faf7c6d5 req-0cea5b26-3c26-4774-a512-7db0c46ced6b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:57.594043 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8b606df3-18e1-4d95-a14d-c2d6faf7c6d5 req-0cea5b26-3c26-4774-a512-7db0c46ced6b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0554402 Nov 18 21:07:57.646857 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8b606df3-18e1-4d95-a14d-c2d6faf7c6d5 req-a742d267-eb37-42a1-89aa-843564e497e8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460720 Nov 18 21:07:58.773641 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f042fe5-3ab2-4396-9581-b71ce6c2a214 req-8de87f1b-82b9-40ca-b2b9-66230f84dc2f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:07:58.775656 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6f042fe5-3ab2-4396-9581-b71ce6c2a214 req-8de87f1b-82b9-40ca-b2b9-66230f84dc2f tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 945 time: 0.0512705 Nov 18 21:07:58.829169 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6f042fe5-3ab2-4396-9581-b71ce6c2a214 req-4f3dc8ef-dd3d-43a5-a918-281e78499ea8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470202 Nov 18 21:07:58.923554 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:07:59.010086 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:59.037633 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:07:59.039916 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79cb3d0c-67b2-429f-864f-3b0e4f94af76" -d '{"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-unplugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:07:59.054122 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:07:59.059441 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:07:59.087531 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Thu, 18 Nov 2021 21:07:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0db5986-37c3-49b2-8da4-4663eac1db4c x-openstack-request-id: req-d0db5986-37c3-49b2-8da4-4663eac1db4c {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:07:59.088592 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-unplugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:07:59.088833 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-d0db5986-37c3-49b2-8da4-4663eac1db4c {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:07:59.089241 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'code': 200} Nov 18 21:07:59.117458 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=8']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:08:00.249235 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0a46d0d-ebdc-4808-85cc-9acbe5f97dc8 req-94c6c741-46d4-4fac-9a73-e42e48b842ff tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:00.250756 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d0a46d0d-ebdc-4808-85cc-9acbe5f97dc8 req-94c6c741-46d4-4fac-9a73-e42e48b842ff tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.3480446 Nov 18 21:08:00.302558 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d0a46d0d-ebdc-4808-85cc-9acbe5f97dc8 req-8f6a0a0c-c1a8-4d87-bff4-7319ade67ea4 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452580 Nov 18 21:08:01.259946 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-7e9b5225-fe15-4891-8691-7add5515800f req-aec11a74-bc9f-44b6-9836-4869be7c309d service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:08:01.260993 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7e9b5225-fe15-4891-8691-7add5515800f req-aec11a74-bc9f-44b6-9836-4869be7c309d service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.1069431 Nov 18 21:08:01.460033 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41f87373-19d3-4ab0-b9b2-ce603b684dff req-9ea618e8-8b10-4175-8f32-173923696754 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:01.461541 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-41f87373-19d3-4ab0-b9b2-ce603b684dff req-9ea618e8-8b10-4175-8f32-173923696754 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0822284 Nov 18 21:08:01.495079 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-32801a3c-d552-4485-9492-08e41fc96b06 service neutron] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0695267 Nov 18 21:08:01.520579 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-41f87373-19d3-4ab0-b9b2-ce603b684dff req-73d2623b-7b5e-492a-a86d-76970f5fe746 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0523033 Nov 18 21:08:02.190113 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a2784e43-b2b5-48df-977a-6b08c220147f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:02.328639 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f788d3-6eae-4459-9f26-27fea174a0de req-3441340d-bdfd-463b-84f8-a74577159af8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:02.330145 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-3441340d-bdfd-463b-84f8-a74577159af8 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e&tenant_id=d6128eda2acb42f3b896c4d4a809ed0e HTTP/1.1" status: 200 len: 1096 time: 0.0474212 Nov 18 21:08:02.394875 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f788d3-6eae-4459-9f26-27fea174a0de req-066d5ef3-35e6-48c2-a61a-33bb680eb4ad service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:02.396473 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-066d5ef3-35e6-48c2-a61a-33bb680eb4ad service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1096 time: 0.0416894 Nov 18 21:08:02.487725 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f788d3-6eae-4459-9f26-27fea174a0de req-f9d1b7e3-ac73-45f1-a7e2-7f6918dbdf18 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:02.489218 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-f9d1b7e3-ac73-45f1-a7e2-7f6918dbdf18 service neutron] 10.222.0.62 "GET /v2.0/networks?id=c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 200 len: 917 time: 0.0842247 Nov 18 21:08:02.565701 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-79f7e6af-7db6-44ae-9ece-69e06671fb95 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.4&port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 200 len: 998 time: 0.0661039 Nov 18 21:08:02.633429 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f788d3-6eae-4459-9f26-27fea174a0de req-8336c687-a765-4679-8feb-1df59724ced1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:02.635168 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-8336c687-a765-4679-8feb-1df59724ced1 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 200 len: 855 time: 0.0513546 Nov 18 21:08:02.657065 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c34eca1-c075-4256-957b-821008317f5a req-88e93865-5f38-4bce-9a5b-5ea16c59c667 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:02.658517 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1c34eca1-c075-4256-957b-821008317f5a req-88e93865-5f38-4bce-9a5b-5ea16c59c667 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0565379 Nov 18 21:08:02.701841 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74f788d3-6eae-4459-9f26-27fea174a0de req-bc8f9448-c338-4b1f-bfd4-8334c0c78ec7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:02.703401 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-bc8f9448-c338-4b1f-bfd4-8334c0c78ec7 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=c212623b-e2b5-4f51-9cd5-a24f8a69f653&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0497749 Nov 18 21:08:02.717542 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1c34eca1-c075-4256-957b-821008317f5a req-2d3d1fbb-8a93-40f5-8404-38ae4b9caebf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518379 Nov 18 21:08:02.813886 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-fe35b31f-5224-4cb1-b174-53b695d664eb service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1016288 Nov 18 21:08:02.908838 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-74f788d3-6eae-4459-9f26-27fea174a0de req-959a5f8d-a8e8-4cb9-8bd0-26c8b0cadbf3 service neutron] 10.222.0.62 "GET /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0875688 Nov 18 21:08:02.937684 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:08:03.877745 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a47e7384-4105-4123-a004-be36e6863511 req-3cf2ae7b-5d10-45dc-9fb0-973f7897b6c2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:03.888905 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a47e7384-4105-4123-a004-be36e6863511 req-3cf2ae7b-5d10-45dc-9fb0-973f7897b6c2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0867376 Nov 18 21:08:03.953885 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a47e7384-4105-4123-a004-be36e6863511 req-5ba1d660-7af4-4b01-a5f2-3ddd00381941 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0636547 Nov 18 21:08:04.626409 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f8a379ba-765b-49dd-92ea-039bb20e9710 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:05.125491 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-876d21ac-af55-4fbc-8026-b84001c5d219 req-1698aec7-269d-4062-a847-6b90e338111d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:05.128586 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-876d21ac-af55-4fbc-8026-b84001c5d219 req-1698aec7-269d-4062-a847-6b90e338111d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0970869 Nov 18 21:08:05.187071 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-876d21ac-af55-4fbc-8026-b84001c5d219 req-bac2f011-cd1a-4b44-8bb1-f345102b3049 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0537648 Nov 18 21:08:06.010401 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:06.340013 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-334b12e2-0558-48de-8f6a-56b3b2ea221c req-ae994da7-091a-4d18-88af-7d7b4e809bd7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:06.341592 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-334b12e2-0558-48de-8f6a-56b3b2ea221c req-ae994da7-091a-4d18-88af-7d7b4e809bd7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0561624 Nov 18 21:08:06.404854 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-334b12e2-0558-48de-8f6a-56b3b2ea221c req-91a0205d-68fe-4653-8e79-a91e22100bfe tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0567539 Nov 18 21:08:07.479781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:07.742570 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b30556fc-de75-452f-9ed8-37a13f24f889 req-009b7427-b850-426b-8164-166e3211eb92 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:07.749906 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b30556fc-de75-452f-9ed8-37a13f24f889 req-009b7427-b850-426b-8164-166e3211eb92 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0667870 Nov 18 21:08:07.809565 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b30556fc-de75-452f-9ed8-37a13f24f889 req-75841694-e9e6-45a0-89bf-e0bf45e4b2e3 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0587120 Nov 18 21:08:08.240072 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:08.982972 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b03a2791-682d-4cab-8418-24e1e6226fed req-0690a211-b8cd-4a8e-a528-334af4612adf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:08.984717 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b03a2791-682d-4cab-8418-24e1e6226fed req-0690a211-b8cd-4a8e-a528-334af4612adf tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0901365 Nov 18 21:08:09.037104 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b03a2791-682d-4cab-8418-24e1e6226fed req-d954dcff-7993-4200-adf3-d2178bf392ba tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464129 Nov 18 21:08:10.206183 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1834013-af4f-48ef-bab7-885ec0dbc208 req-3300819f-9d49-4aee-a21f-828c253df6c8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:10.208142 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c1834013-af4f-48ef-bab7-885ec0dbc208 req-3300819f-9d49-4aee-a21f-828c253df6c8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0660348 Nov 18 21:08:10.266042 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c1834013-af4f-48ef-bab7-885ec0dbc208 req-401b24f0-263e-485c-812e-0f67a6a7c840 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0510859 Nov 18 21:08:11.419511 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66a6ccb3-1d04-4994-9908-5b369245f0b2 req-49a0590e-4edc-4614-9f89-c5e63547ac05 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:11.422479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66a6ccb3-1d04-4994-9908-5b369245f0b2 req-49a0590e-4edc-4614-9f89-c5e63547ac05 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0671530 Nov 18 21:08:11.497200 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-66a6ccb3-1d04-4994-9908-5b369245f0b2 req-a1fabd32-f744-4a58-bfb7-4edc23393ab5 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0695407 Nov 18 21:08:12.635651 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09160b77-d468-4a37-bf64-001837c609fb req-04015da4-9e5c-4b48-90e7-1ef48ec7c222 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:12.643655 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-09160b77-d468-4a37-bf64-001837c609fb req-04015da4-9e5c-4b48-90e7-1ef48ec7c222 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0607278 Nov 18 21:08:12.703285 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-09160b77-d468-4a37-bf64-001837c609fb req-14c619aa-991c-4ba1-8efe-2382adea8390 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582986 Nov 18 21:08:13.862215 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0abff7e-37b7-44dc-bf72-a21d7056d778 req-b3639dbd-18a2-444c-a6cc-ec2ded0c1701 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:13.864797 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d0abff7e-37b7-44dc-bf72-a21d7056d778 req-b3639dbd-18a2-444c-a6cc-ec2ded0c1701 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0819712 Nov 18 21:08:13.931451 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d0abff7e-37b7-44dc-bf72-a21d7056d778 req-2c4b419c-b483-4d41-8408-e07e16514ac7 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0590835 Nov 18 21:08:15.080516 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff4ebf3f-083a-4c6a-a91a-864b03c21689 req-97fdd00a-9b41-46bb-a5c0-d43b5a19fde2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:15.082448 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ff4ebf3f-083a-4c6a-a91a-864b03c21689 req-97fdd00a-9b41-46bb-a5c0-d43b5a19fde2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0597391 Nov 18 21:08:15.139415 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-ff4ebf3f-083a-4c6a-a91a-864b03c21689 req-dca7ead9-c479-4282-8f94-bc73c21fd45d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0497208 Nov 18 21:08:15.800057 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:08:16.282462 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-144f0943-1faa-40ec-b676-623df87b28eb req-04df6bd0-ce80-4414-8a92-2d54da73f0d2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:16.284313 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-144f0943-1faa-40ec-b676-623df87b28eb req-04df6bd0-ce80-4414-8a92-2d54da73f0d2 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0602000 Nov 18 21:08:16.335376 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-144f0943-1faa-40ec-b676-623df87b28eb req-12b62589-cd90-4066-a4ab-a0bed6b2366b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446334 Nov 18 21:08:17.486140 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-043385a3-deac-4e56-b0ab-4518495671b9 req-0ddb84a1-92af-4147-a40e-a0dc35dc3e9b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:17.487635 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-043385a3-deac-4e56-b0ab-4518495671b9 req-0ddb84a1-92af-4147-a40e-a0dc35dc3e9b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0594831 Nov 18 21:08:17.548377 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-043385a3-deac-4e56-b0ab-4518495671b9 req-875a4260-7cb0-463d-8c2a-a137bec23b60 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475838 Nov 18 21:08:18.671531 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87ff551e-0eb9-4d5e-82ec-24e59bac1352 req-7c86197a-468d-4770-9c2a-208eb04e78d0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:18.673131 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-87ff551e-0eb9-4d5e-82ec-24e59bac1352 req-7c86197a-468d-4770-9c2a-208eb04e78d0 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 943 time: 0.0488672 Nov 18 21:08:18.721047 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-87ff551e-0eb9-4d5e-82ec-24e59bac1352 req-716d1370-ea06-4386-a125-48a555c51ca8 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0418096 Nov 18 21:08:18.998404 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:08:19.092991 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:08:19.105548 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'port_id': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'mac_address': 'fa:16:3e:f9:cd:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 614, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.4'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:08:19.146600 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:19.159639 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4dae9221-3452-4f87-b4f2-0cdad7652d8c {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:08:19.178740 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:08:19.182605 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:19.231132 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=9']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:08:19.238388 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.238733 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.239076 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.239410 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.239737 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.240061 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.240616 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.240744 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.241041 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.241360 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.241679 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.242012 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:19.360712 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:19.433904 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['4dae9221-3452-4f87-b4f2-0cdad7652d8c'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:08:19.851652 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d87ae7cb-d067-4d76-b8b2-7f75c36be5ab req-feb77da6-6b8f-4f46-9a77-716b9454cb9b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:19.853275 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d87ae7cb-d067-4d76-b8b2-7f75c36be5ab req-feb77da6-6b8f-4f46-9a77-716b9454cb9b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 944 time: 0.0528889 Nov 18 21:08:19.910002 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d87ae7cb-d067-4d76-b8b2-7f75c36be5ab req-fd171547-f3af-43f4-ae61-2deba0833ab9 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464835 Nov 18 21:08:21.015560 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:08:21.049239 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9778c5b3-db42-4e84-be3c-4385846053da req-4f000c6d-e5d1-4764-813b-96acc79ed093 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:21.050716 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9778c5b3-db42-4e84-be3c-4385846053da req-4f000c6d-e5d1-4764-813b-96acc79ed093 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 944 time: 0.0599735 Nov 18 21:08:21.066872 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 4dae9221-3452-4f87-b4f2-0cdad7652d8c triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:08:21.067598 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:21.112076 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-9778c5b3-db42-4e84-be3c-4385846053da req-203dade6-273d-4465-a86d-501cb905df59 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0550826 Nov 18 21:08:21.153916 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:21.178067 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:08:21.180352 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16bf82df-0c9c-4a0c-87db-406c72bc7dec" -d '{"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-plugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:08:21.194175 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:08:21.199590 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:21.230542 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:08:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ecff9ca-57a1-4571-9f0c-b02104ddc817 x-openstack-request-id: req-6ecff9ca-57a1-4571-9f0c-b02104ddc817 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:08:21.230927 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-plugged", "status": "completed", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:08:21.231246 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-6ecff9ca-57a1-4571-9f0c-b02104ddc817 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:08:21.231684 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'code': 200} Nov 18 21:08:21.263622 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=10']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:08:21.427939 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea3c7319-11ce-4c9f-9168-4a8f1be7abf9 req-9b375eaa-52e4-456f-847b-07d911d9291c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:21.429398 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ea3c7319-11ce-4c9f-9168-4a8f1be7abf9 req-9b375eaa-52e4-456f-847b-07d911d9291c service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 1099 time: 0.0414965 Nov 18 21:08:21.477166 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ea3c7319-11ce-4c9f-9168-4a8f1be7abf9 req-0e5a3262-1955-4853-a6d3-50249b2ebeff service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0396476 Nov 18 21:08:22.238672 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646af054-cf3e-432d-b238-64450eb2867f req-fcbfaee9-33bd-413e-9ffc-4ddcbc971cbe tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:22.240193 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-646af054-cf3e-432d-b238-64450eb2867f req-fcbfaee9-33bd-413e-9ffc-4ddcbc971cbe tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 946 time: 0.0508926 Nov 18 21:08:22.307755 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-646af054-cf3e-432d-b238-64450eb2867f req-87cff8fe-7754-47bc-849d-7c0830244430 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0600278 Nov 18 21:08:23.458375 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-53ce5652-a7a2-4119-a82c-4b141a50bf0e req-af25da1a-09d6-4e45-bcbc-20ef70fb9f7b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:23.459756 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-53ce5652-a7a2-4119-a82c-4b141a50bf0e req-af25da1a-09d6-4e45-bcbc-20ef70fb9f7b tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 946 time: 0.0534518 Nov 18 21:08:23.508513 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-53ce5652-a7a2-4119-a82c-4b141a50bf0e req-98df60a1-8ac4-481f-8a08-89ff98e6222e tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423653 Nov 18 21:08:30.335368 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccc1531a-6f8a-446b-b979-413f74b8aab9 req-521c4651-3faa-4a3a-9bd0-f803a5df2c66 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:30.336888 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ccc1531a-6f8a-446b-b979-413f74b8aab9 req-521c4651-3faa-4a3a-9bd0-f803a5df2c66 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0519423 Nov 18 21:08:30.385151 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ccc1531a-6f8a-446b-b979-413f74b8aab9 req-9a728660-2bef-4b19-895b-26952f66185e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0415411 Nov 18 21:08:31.511684 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eeeefba3-684f-4970-8aa3-d5ef07e01dd2 req-c85bcabb-54a2-4c4c-8f8c-5eabe3a0b020 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:31.513203 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eeeefba3-684f-4970-8aa3-d5ef07e01dd2 req-c85bcabb-54a2-4c4c-8f8c-5eabe3a0b020 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0510542 Nov 18 21:08:31.564704 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-eeeefba3-684f-4970-8aa3-d5ef07e01dd2 req-818e0878-3ad7-4c34-a4e7-49a386692451 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0454648 Nov 18 21:08:32.192790 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-71c22e90-ae43-402b-9335-a9c57d7332e4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:32.683542 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd534de8-512b-47e0-833c-a5a2b8d14a8b req-208fd9bb-27d1-4381-908e-579a678ee38e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:32.685047 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd534de8-512b-47e0-833c-a5a2b8d14a8b req-208fd9bb-27d1-4381-908e-579a678ee38e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0504727 Nov 18 21:08:32.734870 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-cd534de8-512b-47e0-833c-a5a2b8d14a8b req-3dc44c54-ec05-473d-b41b-2623a278dc9a tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438573 Nov 18 21:08:33.852899 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da6794e9-a8b0-4bf2-a5f6-2cd333704cce req-4cfa152d-0799-486b-bd2f-6d658bc07618 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:33.855323 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-da6794e9-a8b0-4bf2-a5f6-2cd333704cce req-4cfa152d-0799-486b-bd2f-6d658bc07618 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0511389 Nov 18 21:08:33.907866 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-da6794e9-a8b0-4bf2-a5f6-2cd333704cce req-3a0cd776-9675-48a5-9f3d-47a61b237ca9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0464342 Nov 18 21:08:34.628386 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-18fc544c-feee-435e-99c6-0366eceba6ba None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:35.038804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e71a5577-4464-45a1-9f86-a9bd78404106 req-09116739-b959-4e26-8720-49085c9a68a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:35.040386 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e71a5577-4464-45a1-9f86-a9bd78404106 req-09116739-b959-4e26-8720-49085c9a68a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0593739 Nov 18 21:08:35.089058 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e71a5577-4464-45a1-9f86-a9bd78404106 req-9c326a77-2443-4558-a2a7-cb6c0e547bd6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0425372 Nov 18 21:08:36.012498 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:36.208889 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-835cf071-0f0c-46da-96f0-2c8bbd56cc42 req-068b5dda-d062-455a-93aa-be416e3e2157 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:36.210393 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-835cf071-0f0c-46da-96f0-2c8bbd56cc42 req-068b5dda-d062-455a-93aa-be416e3e2157 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0500455 Nov 18 21:08:36.258795 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-835cf071-0f0c-46da-96f0-2c8bbd56cc42 req-88dd042c-29b7-4b11-97ed-b89545f048d5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0422814 Nov 18 21:08:37.374045 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-198e1e10-23dd-4dcc-836d-8a3580d5ae8e req-7e9b6c94-d0d5-4fe4-9898-adbbaba0f180 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:37.375585 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-198e1e10-23dd-4dcc-836d-8a3580d5ae8e req-7e9b6c94-d0d5-4fe4-9898-adbbaba0f180 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0491455 Nov 18 21:08:37.429416 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-198e1e10-23dd-4dcc-836d-8a3580d5ae8e req-09c54b28-7043-4f6e-abae-c4018bb5355e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479119 Nov 18 21:08:37.466341 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:38.242293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:38.554084 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a461a3b-a151-4e7e-a536-e20a317edc1e req-253744fc-7e91-47f5-8275-dfb729fb6403 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:38.555455 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6a461a3b-a151-4e7e-a536-e20a317edc1e req-253744fc-7e91-47f5-8275-dfb729fb6403 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0480583 Nov 18 21:08:38.614010 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6a461a3b-a151-4e7e-a536-e20a317edc1e req-6ff82599-c49c-436c-a76f-6155d9ff24fb tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0503199 Nov 18 21:08:39.734609 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82b640f9-5c5a-4c0b-93ce-88a546012562 req-be5171ad-1bed-47c2-b58c-37dd497ac9ea tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:39.736164 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82b640f9-5c5a-4c0b-93ce-88a546012562 req-be5171ad-1bed-47c2-b58c-37dd497ac9ea tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0532453 Nov 18 21:08:39.784181 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82b640f9-5c5a-4c0b-93ce-88a546012562 req-786170ce-1a01-46db-a6d7-af340d6a1903 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0420699 Nov 18 21:08:40.905142 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c83b7a39-b342-4f6d-8b6d-a9e8ba94ff3f req-500d6d02-00df-4ddc-b10d-69efe034e7e5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:40.906622 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c83b7a39-b342-4f6d-8b6d-a9e8ba94ff3f req-500d6d02-00df-4ddc-b10d-69efe034e7e5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0539448 Nov 18 21:08:40.955574 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c83b7a39-b342-4f6d-8b6d-a9e8ba94ff3f req-b9bf5e4a-8869-4639-9883-61bff2277e4f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0429542 Nov 18 21:08:41.166778 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19feb884-48a3-4b79-bc4d-b556fe79b9a3 req-fd35b735-f709-4db1-8ce7-d2c5d5bbbd7b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:41.168335 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-19feb884-48a3-4b79-bc4d-b556fe79b9a3 req-fd35b735-f709-4db1-8ce7-d2c5d5bbbd7b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0534101 Nov 18 21:08:41.208073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-b997c78f-5b19-4fd2-b433-cfbb469ada73 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:41.209626 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-b997c78f-5b19-4fd2-b433-cfbb469ada73 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1099 time: 0.0416279 Nov 18 21:08:41.216878 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-19feb884-48a3-4b79-bc4d-b556fe79b9a3 req-650ff31c-5181-405c-bd5a-202ea8ee3369 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0423963 Nov 18 21:08:41.307860 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-750b16a9-acb3-49cb-b9a6-596477912cc4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:41.309371 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-750b16a9-acb3-49cb-b9a6-596477912cc4 service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.0901239 Nov 18 21:08:41.378306 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-12ab61c5-eddc-48d5-93a0-85f3abc24b3e service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 1001 time: 0.0598142 Nov 18 21:08:41.433441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-89dcd1f5-6614-445c-b483-8825736cf2fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:41.434911 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-89dcd1f5-6614-445c-b483-8825736cf2fb service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0466843 Nov 18 21:08:41.486183 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-7c3d864a-0153-43cb-8379-29340f743278 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:41.491544 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-7c3d864a-0153-43cb-8379-29340f743278 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0450699 Nov 18 21:08:41.584493 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-1b19f2d8-eeb6-41a7-a8de-501922081430 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0854490 Nov 18 21:08:41.677912 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-82e6f878-eb10-4d69-8c10-ab1cceab2fda req-364bcf6f-ea6a-4a0e-a92f-20d7536c9d9f service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859947 Nov 18 21:08:42.352361 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9d18457-fca1-4008-b9b3-66464b14575d req-c2745386-a60c-4740-b647-75c76208fe4d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:42.355227 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f9d18457-fca1-4008-b9b3-66464b14575d req-c2745386-a60c-4740-b647-75c76208fe4d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0594416 Nov 18 21:08:42.406305 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f9d18457-fca1-4008-b9b3-66464b14575d req-43a14002-5163-4a8d-9c82-2830bef777f2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0452929 Nov 18 21:08:49.375467 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:52.799943 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:08:53.640478 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41192) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:08:53.695549 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-aa726482-304a-48ca-8c06-5c4df7590f91 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0489552 Nov 18 21:08:53.775756 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-bd0051a1-4daf-4c7e-adb7-ade3f90e82f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:53.777559 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-bd0051a1-4daf-4c7e-adb7-ade3f90e82f6 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 1099 time: 0.0547652 Nov 18 21:08:53.976834 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-0e6f0212-645e-4fe1-80c0-959a304b22fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:53.978338 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-0e6f0212-645e-4fe1-80c0-959a304b22fb service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.1669917 Nov 18 21:08:54.079200 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-52a6b913-ec60-4c9e-b029-7372725f9f78 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 200 len: 1001 time: 0.0834904 Nov 18 21:08:54.086474 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Deleting port 318132e8-efe9-440d-beb6-c1172232a741 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:08:54.087065 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:54.180804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-844942f9-03fc-4ae2-9539-f5487fbbf155 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:54.182862 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-844942f9-03fc-4ae2-9539-f5487fbbf155 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0927351 Nov 18 21:08:54.232638 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:54.232865 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:54.249393 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Calling delete_port for 318132e8-efe9-440d-beb6-c1172232a741 owned by network:floatingip {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:08:54.269950 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-e9389b6e-75f2-4611-b482-6300cd30b648 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:54.271201 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-e9389b6e-75f2-4611-b482-6300cd30b648 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0776019 Nov 18 21:08:54.452419 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-44705ff6-71c8-4659-b49d-85d6591e5a8e service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1449039 Nov 18 21:08:54.583517 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5534a173-038d-4529-85d1-c9c3e5afb18e req-c355fb8f-b5b9-4854-a4f5-2ed48298f327 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1226926 Nov 18 21:08:54.591006 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:54.622377 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event deleted for resources: {'Port': ['ID=318132e8-efe9-440d-beb6-c1172232a741,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:08:54.635100 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.635453 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.635793 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.636194 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.636475 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.636799 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.637122 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.637437 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.637755 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.638074 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.638523 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.638702 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:08:54.697933 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for floatingip, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:54.699066 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Floating IP e5b8911c-f58a-4b7c-a107-4e41d41f6b35 disassociated (deleted). External IP: 172.27.3.169, port: 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072. Nov 18 21:08:54.946299 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:08:55.085134 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:08:55.091068 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:55.098568 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] Sync routers for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:08:55.112560 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:08:55.113474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:08:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:08:55.141638 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a852b7b5-5369-4c1d-9c0d-3cb33be34ca1 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "DELETE /v2.0/floatingips/e5b8911c-f58a-4b7c-a107-4e41d41f6b35 HTTP/1.1" status: 204 len: 168 time: 1.5000248 Nov 18 21:08:55.142229 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:08:55.144667 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95" -d '{"events": [{"name": "network-changed", "server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:08:55.188084 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:08:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-19bfb5c7-7ef1-4221-bff4-afb9aff2672b x-openstack-request-id: req-19bfb5c7-7ef1-4221-bff4-afb9aff2672b {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:08:55.188520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:08:55.188721 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-19bfb5c7-7ef1-4221-bff4-afb9aff2672b {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:08:55.189031 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'status': 'completed', 'code': 200} Nov 18 21:08:55.269160 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:08:55.271578 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-b95022bd-ce11-486c-94fb-69c186ffc6b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:55.274097 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-b95022bd-ce11-486c-94fb-69c186ffc6b6 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 1099 time: 0.0514495 Nov 18 21:08:55.456615 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5acc85d5-f48c-459a-b257-593de7867e97 req-536d8c44-79c4-4833-a62d-f91729d27a74 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:55.458187 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5acc85d5-f48c-459a-b257-593de7867e97 req-536d8c44-79c4-4833-a62d-f91729d27a74 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0769005 Nov 18 21:08:55.484048 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-da36fbbf-250b-4f4b-874a-089faf181acf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:55.490092 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-da36fbbf-250b-4f4b-874a-089faf181acf service neutron] 10.222.0.62 "GET /v2.0/networks?id=95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 200 len: 910 time: 0.1785729 Nov 18 21:08:55.542635 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-0de5846a-4857-4b11-aa5c-573215efe659 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 200 len: 217 time: 0.0489054 Nov 18 21:08:55.585115 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:24Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:08:55.621779 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5acc85d5-f48c-459a-b257-593de7867e97 req-687bbbf0-faff-4bb0-9073-58adf7bcda11 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.1487515 Nov 18 21:08:55.647252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] Checking router: 7ff3c29a-4ec9-401d-888e-f0fe474fba95 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:08:55.653418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-176be938-6d41-48de-a4a5-73eb232dd224 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:55.655325 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-176be938-6d41-48de-a4a5-73eb232dd224 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 200 len: 848 time: 0.0956373 Nov 18 21:08:55.658335 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:08:55.658963 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:08:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:08:55.723790 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-851c9d51-7f96-4e5e-b1b0-8ceca291b7db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:55.725312 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-851c9d51-7f96-4e5e-b1b0-8ceca291b7db service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=95263b3e-fd72-450c-984a-4cc58b6e2e30&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0519493 Nov 18 21:08:55.815876 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:08:55.848148 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-76bab206-4e9e-4df1-8b03-175a3a0699ca service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1108119 Nov 18 21:08:55.951491 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ada29e4-9049-4fef-9b07-2ea9cdbe0a95 req-eadebe2d-9b46-40c4-a439-a0acaf7c2fe7 service neutron] 10.222.0.62 "GET /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924559 Nov 18 21:08:56.069165 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:24Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:08:56.105092 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-087d292b-6c01-4a17-99ad-a586f2cd542c None None] The sync data for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi is: [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:02:17Z', 'revision_number': 4, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a', 'name': '', 'network_id': '95263b3e-fd72-450c-984a-4cc58b6e2e30', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'mac_address': 'fa:16:3e:c0:d4:28', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_interface', 'standard_attr_id': 316, 'fixed_ips': [{'subnet_id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:15Z', 'updated_at': '2021-11-18T21:02:24Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'subnets': [{'id': '6050df59-9d5e-44e2-bfe4-f42645dc02a5', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:08:56.342890 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-283a68d7-9562-4d18-9fe4-13b4282ef81d None None] New status for floating IP e5b8911c-f58a-4b7c-a107-4e41d41f6b35: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:08:56.773106 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-56c93df2-3460-42b9-95aa-13e4a4f24558 req-6407ea0c-19e5-4bc0-b5b1-8f2d2d66fcaf tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:56.774604 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-56c93df2-3460-42b9-95aa-13e4a4f24558 req-6407ea0c-19e5-4bc0-b5b1-8f2d2d66fcaf tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0634658 Nov 18 21:08:56.827471 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-56c93df2-3460-42b9-95aa-13e4a4f24558 req-ed36ca99-33c8-4317-bdf8-8135fa3a234f tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0451255 Nov 18 21:08:57.313973 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-593af6e3-e8ea-4a59-b8af-5cdd1151eece req-f0efdb55-4768-46ca-9db6-9d00e8c4bb3a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:57.315511 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-593af6e3-e8ea-4a59-b8af-5cdd1151eece req-f0efdb55-4768-46ca-9db6-9d00e8c4bb3a tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 946 time: 0.0565231 Nov 18 21:08:57.379121 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-593af6e3-e8ea-4a59-b8af-5cdd1151eece req-775acf9b-2be4-433f-a2e9-657ada775a83 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0530670 Nov 18 21:08:57.535139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-31725ed4-dc89-44f3-b1d4-da0c886ebe74 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:57.536542 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-31725ed4-dc89-44f3-b1d4-da0c886ebe74 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.62 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0558991 Nov 18 21:08:57.653099 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Deleting port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:08:57.653553 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:57.753637 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] For port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:08:57.754050 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:57.769027 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Calling delete_port for 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:08:57.965522 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b7089a24-cae3-45af-98a8-0dc811184655 req-863e4507-afe5-41af-9d32-f64d59661ab2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:57.967161 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7089a24-cae3-45af-98a8-0dc811184655 req-863e4507-afe5-41af-9d32-f64d59661ab2 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 946 time: 0.0620186 Nov 18 21:08:58.037569 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b7089a24-cae3-45af-98a8-0dc811184655 req-b8b6cb44-fb96-4f81-a456-08b1914ad262 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/security-groups?id=fbc78986-4204-4d3e-b1de-819272f7cec2&fields=id&fields=name HTTP/1.1" status: 200 len: 311 time: 0.0633118 Nov 18 21:08:58.198442 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:58.234285 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event deleted for resources: {'Port': ['ID=3efc1cde-bec6-4c4e-8d6f-abb2cecd7072,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:08:58.272736 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] No DVR routers for this DVR port 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:08:58.276066 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:58.279424 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e8a6fdf1-7797-4366-ad72-688dc6c3f5a1 req-c734eb27-f90a-4ad1-bf00-82dadbf5bf00 tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.62 "DELETE /v2.0/ports/3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 HTTP/1.1" status: 204 len: 173 time: 0.7348216 Nov 18 21:08:58.279882 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-deleted', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:08:58.282305 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c848c62e-bb0f-4bae-8746-13fcd189d132" -d '{"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-deleted", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:08:58.332194 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:08:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6059e88f-f417-44ce-9850-9d9c6d48e7ed x-openstack-request-id: req-6059e88f-f417-44ce-9850-9d9c6d48e7ed {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:08:58.332914 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b10bcf8f-8755-4563-90db-a65606917bcb", "name": "network-vif-deleted", "tag": "3efc1cde-bec6-4c4e-8d6f-abb2cecd7072", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:08:58.332914 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-6059e88f-f417-44ce-9850-9d9c6d48e7ed {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:08:58.333375 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b10bcf8f-8755-4563-90db-a65606917bcb', 'name': 'network-vif-deleted', 'tag': '3efc1cde-bec6-4c4e-8d6f-abb2cecd7072', 'status': 'completed', 'code': 200} Nov 18 21:08:58.524072 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132859f7-d6ba-4c9a-90fa-cd53f9c9fb30 req-c356c24d-470c-4a13-9e1b-5c1688ff5709 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:58.526231 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-132859f7-d6ba-4c9a-90fa-cd53f9c9fb30 req-c356c24d-470c-4a13-9e1b-5c1688ff5709 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 946 time: 0.0540111 Nov 18 21:08:58.596399 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-132859f7-d6ba-4c9a-90fa-cd53f9c9fb30 req-695cd056-e771-4b45-9f49-09c004caccfd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0634508 Nov 18 21:08:59.177400 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d723de9a-d4a1-4520-aa34-ee80770b0f44 req-26b64e26-6cee-4562-bdaf-fda3eb45a86c tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "GET /v2.0/ports?device_id=b10bcf8f-8755-4563-90db-a65606917bcb HTTP/1.1" status: 200 len: 210 time: 0.0440149 Nov 18 21:08:59.198291 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-967ba430-f931-409d-a0ed-82572df13932 req-1fe6b5e5-7122-419e-8bc1-2349dabcf867 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:59.199753 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-967ba430-f931-409d-a0ed-82572df13932 req-1fe6b5e5-7122-419e-8bc1-2349dabcf867 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 946 time: 0.0748188 Nov 18 21:08:59.298042 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Deleting port 4dae9221-3452-4f87-b4f2-0cdad7652d8c {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:08:59.298620 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:59.390272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] For port 4dae9221-3452-4f87-b4f2-0cdad7652d8c, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=4dae9221-3452-4f87-b4f2-0cdad7652d8c,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:08:59.390950 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:59.560679 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:59.561057 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:59.561397 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Floating IP ccac4be5-c314-4ead-8886-c17f6ea42387 disassociated. External IP: 172.27.3.12, port: 4dae9221-3452-4f87-b4f2-0cdad7652d8c. Nov 18 21:08:59.561863 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Calling delete_port for 4dae9221-3452-4f87-b4f2-0cdad7652d8c owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:08:59.696092 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:08:59.730999 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event deleted for resources: {'Port': ['ID=4dae9221-3452-4f87-b4f2-0cdad7652d8c,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:08:59.743117 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c9716a7f-bc1e-4ad1-be3a-e0531fbab610 req-e4ab0a5a-25b4-4014-8341-add632b8da56 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:08:59.751602 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c9716a7f-bc1e-4ad1-be3a-e0531fbab610 req-e4ab0a5a-25b4-4014-8341-add632b8da56 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/ports?device_id=b0830171-6c9b-4d8a-a075-23735eec347e HTTP/1.1" status: 200 len: 868 time: 0.0745029 Nov 18 21:08:59.799508 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c9716a7f-bc1e-4ad1-be3a-e0531fbab610 req-cea3fd19-9d0f-4339-90f1-120257515883 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups?id=a5c84e6b-4dd1-4c46-b94d-2def5d569268&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0470228 Nov 18 21:08:59.861801 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:08:59.982876 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:08:59.992699 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:00.002808 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:00.003692 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:08:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:00.022573 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] No DVR routers for this DVR port 4dae9221-3452-4f87-b4f2-0cdad7652d8c on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:09:00.025887 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:00.029577 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-967ba430-f931-409d-a0ed-82572df13932 req-f40afac4-6c47-42fa-a415-99467da3eb7d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.62 "DELETE /v2.0/ports/4dae9221-3452-4f87-b4f2-0cdad7652d8c HTTP/1.1" status: 204 len: 173 time: 0.8233900 Nov 18 21:09:00.248470 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41228) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:00.267685 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:00.334327 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-deleted', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:09:00.336538 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-385a0e79-a773-44a5-aae8-f1bfe3cc54de" -d '{"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-deleted", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:09:00.341237 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5478c376-9226-417d-a7b8-aa27a372745a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:00.383612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5478c376-9226-417d-a7b8-aa27a372745a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:00.398199 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:09:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57135b53-1039-443e-a6db-5a2eaa8d389c x-openstack-request-id: req-57135b53-1039-443e-a6db-5a2eaa8d389c {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:09:00.399210 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b0830171-6c9b-4d8a-a075-23735eec347e", "name": "network-vif-deleted", "tag": "4dae9221-3452-4f87-b4f2-0cdad7652d8c", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:09:00.399210 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-57135b53-1039-443e-a6db-5a2eaa8d389c {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:09:00.400086 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b0830171-6c9b-4d8a-a075-23735eec347e', 'name': 'network-vif-deleted', 'tag': '4dae9221-3452-4f87-b4f2-0cdad7652d8c', 'status': 'completed', 'code': 200} Nov 18 21:09:00.476664 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5478c376-9226-417d-a7b8-aa27a372745a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:00.482235 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5478c376-9226-417d-a7b8-aa27a372745a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:00.483749 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5478c376-9226-417d-a7b8-aa27a372745a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] 10.222.0.61 "DELETE /v2.0/security-groups/fbc78986-4204-4d3e-b1de-819272f7cec2 HTTP/1.1" status: 204 len: 168 time: 0.2344151 Nov 18 21:09:00.502441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5478c376-9226-417d-a7b8-aa27a372745a tempest-TestShelveInstance-229611316 tempest-TestShelveInstance-229611316-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=fbc78986-4204-4d3e-b1de-819272f7cec2,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:00.513364 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:00.545878 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:00.555423 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41234) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:00.560355 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:00.561474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:08:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:00.695850 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:00.898181 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41242) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:00.955780 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:00.960445 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3fa44e0e-1659-4b03-9ab6-1f057723507d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:00.985274 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-feee5b7e-75e9-4439-a152-ae0bf805c104 None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:00:50Z', 'revision_number': 4, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e140da03-4af4-43e2-8e18-8669d09e9d76', 'name': '', 'network_id': 'c212623b-e2b5-4f51-9cd5-a24f8a69f653', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'mac_address': 'fa:16:3e:1b:8c:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_interface', 'standard_attr_id': 89, 'fixed_ips': [{'subnet_id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:45Z', 'updated_at': '2021-11-18T21:00:58Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'subnets': [{'id': 'bc253697-be56-4044-aeb5-455225f5b7ab', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:00.988390 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3fa44e0e-1659-4b03-9ab6-1f057723507d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.055070 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3fa44e0e-1659-4b03-9ab6-1f057723507d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.058442 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3fa44e0e-1659-4b03-9ab6-1f057723507d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.062246 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3fa44e0e-1659-4b03-9ab6-1f057723507d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "DELETE /v2.0/security-groups/a5c84e6b-4dd1-4c46-b94d-2def5d569268 HTTP/1.1" status: 204 len: 168 time: 0.1628489 Nov 18 21:09:01.062917 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41244) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:01.083953 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.api.v2.resource [None req-30c2c3fe-df29-4f00-889a-7ab92eb5ca83 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] show failed (client error): The resource could not be found. Nov 18 21:09:01.084945 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-30c2c3fe-df29-4f00-889a-7ab92eb5ca83 tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "GET /v2.0/security-groups/a5c84e6b-4dd1-4c46-b94d-2def5d569268 HTTP/1.1" status: 404 len: 347 time: 0.0182784 Nov 18 21:09:01.086005 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fa44e0e-1659-4b03-9ab6-1f057723507d tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=a5c84e6b-4dd1-4c46-b94d-2def5d569268,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:01.090379 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41246) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:01.230086 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Deleting port f13090ba-306c-4b11-a0d3-54deba2c0271 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:01.230434 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.302098 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:01.303526 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ecb05443-903c-4dcb-894d-62446cbe8033 None None] New status for floating IP ccac4be5-c314-4ead-8886-c17f6ea42387: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:09:01.327699 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 4dae9221-3452-4f87-b4f2-0cdad7652d8c {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:01.328324 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 4dae9221-3452-4f87-b4f2-0cdad7652d8c not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:01.328849 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:01.329930 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.330439 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.344312 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Calling delete_port for f13090ba-306c-4b11-a0d3-54deba2c0271 owned by network:floatingip {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:01.351430 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:01.351869 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 3efc1cde-bec6-4c4e-8d6f-abb2cecd7072 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:01.373663 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.599217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.622392 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Pushing event deleted for resources: {'Port': ['ID=f13090ba-306c-4b11-a0d3-54deba2c0271,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:01.643810 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Deleting port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:01.644365 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.688913 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks [] for floatingip, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.691434 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.692643 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-3a06913a-2d07-463a-8489-d8317f95c1cd tempest-AttachVolumeShelveTestJSON-995074029 tempest-AttachVolumeShelveTestJSON-995074029-project] 10.222.0.61 "DELETE /v2.0/floatingips/ccac4be5-c314-4ead-8886-c17f6ea42387 HTTP/1.1" status: 204 len: 168 time: 0.6008995 Nov 18 21:09:01.727637 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] For port 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:01.729464 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.741737 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Calling delete_port for 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a owned by network:router_interface {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:01.947207 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:01.988568 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Pushing event deleted for resources: {'Port': ['ID=0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:02.023200 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.023639 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.024070 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.024632 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.024996 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.025345 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.025682 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.026018 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.026354 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.026686 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.027011 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.027336 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:02.175092 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:02.197436 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-2d64ae1c-5b63-4404-b815-535f9a1f4240 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:02.397698 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:02.517591 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:02.522634 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-92a9cd03-6761-473c-9207-2c3ff20d5e15 admin admin] 10.222.0.61 "PUT /v2.0/routers/7ff3c29a-4ec9-401d-888e-f0fe474fba95/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9653594 Nov 18 21:09:02.525680 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41252) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:02.528302 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] Sync routers for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:02.539539 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:02.540865 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:08:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:02.632691 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks [] for router, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:02.649272 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:02.738820 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:02.796473 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Deleting port 519929a2-1d7a-4c44-aee6-01acb44dddc3 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:02.796810 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:02.839276 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2'}], 'enable_snat': True}, 'gw_port_id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:09:01Z', 'revision_number': 5, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port': {'id': '519929a2-1d7a-4c44-aee6-01acb44dddc3', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:5d:c3:4d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'device_owner': 'network:router_gateway', 'standard_attr_id': 292, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.2', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:11Z', 'updated_at': '2021-11-18T21:02:20Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:02.871618 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] Checking router: 7ff3c29a-4ec9-401d-888e-f0fe474fba95 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:02.880456 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] Routers {'7ff3c29a-4ec9-401d-888e-f0fe474fba95'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:02.881072 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 5, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 5, "log_agent_heartbeats": false, "routers": 5},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:08:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:02.883420 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] For port 519929a2-1d7a-4c44-aee6-01acb44dddc3, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=519929a2-1d7a-4c44-aee6-01acb44dddc3,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:02.884598 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:02.898881 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Calling delete_port for 519929a2-1d7a-4c44-aee6-01acb44dddc3 owned by network:router_gateway {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:02.970540 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] Set router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 gateway port host: None {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:03.029382 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:09:02Z', 'revision_number': 6, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:03.080894 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aad768e-7d21-44ff-83f4-91e91d0c42ee None None] The sync data for ids ['7ff3c29a-4ec9-401d-888e-f0fe474fba95'] in dv-cinder-799871-8-iscsi is: [{'id': '7ff3c29a-4ec9-401d-888e-f0fe474fba95', 'name': 'tempest-TestShelveInstance-1335391601-router', 'tenant_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:09Z', 'updated_at': '2021-11-18T21:09:02Z', 'revision_number': 6, 'project_id': 'd0f1cb43ab064a5388db98bf6b8228fa', 'gw_port_host': None}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:03.106279 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.133313 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Pushing event deleted for resources: {'Port': ['ID=519929a2-1d7a-4c44-aee6-01acb44dddc3,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:03.201870 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.299141 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.301267 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.346375 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.346976 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7ff3c29a-4ec9-401d-888e-f0fe474fba95 {{(pid=102670) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:09:03.352293 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.354284 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-81d9a734-418f-4f71-a610-467af7dc695f admin admin] 10.222.0.61 "DELETE /v2.0/routers/7ff3c29a-4ec9-401d-888e-f0fe474fba95 HTTP/1.1" status: 204 len: 168 time: 0.8276927 Nov 18 21:09:03.356903 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41264) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:03.401965 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Deleting subnet 6050df59-9d5e-44e2-bfe4-f42645dc02a5 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:09:03.405320 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.446067 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.530751 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.583858 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.614270 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=6050df59-9d5e-44e2-bfe4-f42645dc02a5,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:03.616261 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.619492 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-965e57e3-565d-4e17-aaad-543056e69d01 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/6050df59-9d5e-44e2-bfe4-f42645dc02a5 HTTP/1.1" status: 204 len: 168 time: 0.2616439 Nov 18 21:09:03.621127 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-edc9e23a-7fae-4bd9-a5c2-aae78b965071 None None] Network 95263b3e-fd72-450c-984a-4cc58b6e2e30 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:03.621974 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41266) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:03.692765 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.747764 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Deleting port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:03.748099 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.821909 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] For port cf344c4a-1b6f-4a66-9a2b-e496beb5e932, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,segment=NetworkSegment(bf2c2c71-75a6-42ae-975a-74838c37b243),segment_id=bf2c2c71-75a6-42ae-975a-74838c37b243)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:03.822757 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.836299 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Calling delete_port for cf344c4a-1b6f-4a66-9a2b-e496beb5e932 owned by network:dhcp {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:03.874858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] DHCP port deletion for 95263b3e-fd72-450c-984a-4cc58b6e2e30 request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:09:03.926467 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.943842 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Deleting port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 {{(pid=102671) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:03.944399 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:03.948358 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:03.955167 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Pushing event deleted for resources: {'Port': ['ID=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:03.957372 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] No DVR routers for this DVR port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 on host dv-cinder-799871-8-iscsi {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:09:04.007416 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:04.007765 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0fb9c5bd-4ff8-49ce-acbe-ce8a86195b1a not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:04.008211 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device cf344c4a-1b6f-4a66-9a2b-e496beb5e932 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:04.037090 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: cf344c4a-1b6f-4a66-9a2b-e496beb5e932 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:04.037343 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.037470 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device cf344c4a-1b6f-4a66-9a2b-e496beb5e932 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:04.037842 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 519929a2-1d7a-4c44-aee6-01acb44dddc3 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:04.059502 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['95263b3e-fd72-450c-984a-4cc58b6e2e30']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:04.062498 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 519929a2-1d7a-4c44-aee6-01acb44dddc3 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:04.062850 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 519929a2-1d7a-4c44-aee6-01acb44dddc3 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:04.073375 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'bf2c2c71-75a6-42ae-975a-74838c37b243') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:04.073663 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'bf2c2c71-75a6-42ae-975a-74838c37b243') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:04.075836 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] For port cf344c4a-1b6f-4a66-9a2b-e496beb5e932, host dv-cinder-799871-8-iscsi, got binding levels [] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:04.076394 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.090789 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.107043 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Calling delete_port for cf344c4a-1b6f-4a66-9a2b-e496beb5e932 owned by network:dhcp {{(pid=102671) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:04.108798 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.109838 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.ipam_backend_mixin [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 was not found and therefore no delete operation was performed {{(pid=102671) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 18 21:09:04.111957 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583'] for port, after_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.117539 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Releasing vlan 637 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:09:04.118017 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:09:04.120592 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:09:04.151215 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] Pushing event deleted for resources: {'Port': ['ID=cf344c4a-1b6f-4a66-9a2b-e496beb5e932,revision_number=None']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:04.157183 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cf2bfd93-a14d-4e9f-89f5-5f300facf417 None None] No DVR routers for this DVR port cf344c4a-1b6f-4a66-9a2b-e496beb5e932 on host dv-cinder-799871-8-iscsi {{(pid=102671) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:09:04.202410 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.211635 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41274) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:04.213337 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.216567 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] 10.222.0.61 "DELETE /v2.0/networks/95263b3e-fd72-450c-984a-4cc58b6e2e30 HTTP/1.1" status: 204 len: 168 time: 0.5936804 Nov 18 21:09:04.221272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41276) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:04.231700 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f144fba0-bac5-4340-97a7-2b2f8b786fc3 admin admin] Pushing event deleted for resources: {'Network': ['ID=95263b3e-fd72-450c-984a-4cc58b6e2e30,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:04.629859 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7d6344ea-75cc-43b1-85f4-f4b908fd51f1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.921234 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:04.964342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:05.674168 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Deleting port ae3c0e28-7521-44dd-b940-2b4e1c1ace76 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:05.675080 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:05.724237 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Deleting port e140da03-4af4-43e2-8e18-8669d09e9d76 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:05.724577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:05.817476 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] For port ae3c0e28-7521-44dd-b940-2b4e1c1ace76, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,segment=NetworkSegment(89de1c6b-c41f-466f-9ac5-1885b681ff12),segment_id=89de1c6b-c41f-466f-9ac5-1885b681ff12)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:05.817850 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:05.839847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Calling delete_port for ae3c0e28-7521-44dd-b940-2b4e1c1ace76 owned by network:router_interface {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:05.847450 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] For port e140da03-4af4-43e2-8e18-8669d09e9d76, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=e140da03-4af4-43e2-8e18-8669d09e9d76,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:05.847713 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:05.865773 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Calling delete_port for e140da03-4af4-43e2-8e18-8669d09e9d76 owned by network:router_interface {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:06.016048 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:06.182537 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:06.208885 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:06.214620 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Pushing event deleted for resources: {'Port': ['ID=ae3c0e28-7521-44dd-b940-2b4e1c1ace76,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:06.262764 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Pushing event deleted for resources: {'Port': ['ID=e140da03-4af4-43e2-8e18-8669d09e9d76,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:06.554275 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:06.555924 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:06.947874 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Router 283e8f99-9b30-4e79-a84e-691b2bc0be7b has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:06.951927 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:07.151670 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:07.156739 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-4f0d4d87-2a1a-43ee-84cd-f5346ffa046e admin admin] 10.222.0.61 "PUT /v2.0/routers/283e8f99-9b30-4e79-a84e-691b2bc0be7b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9342215 Nov 18 21:09:07.158331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:07.159408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41280) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:07.160803 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] Sync routers for ids ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:07.164155 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7ec7fc32-170e-4fe8-9386-3c03c3eb1cfa admin admin] 10.222.0.61 "PUT /v2.0/routers/def0e3d1-c7be-4250-990a-3b6d3d56f9a0/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9502275 Nov 18 21:09:07.167556 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41282) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:07.173483 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] Routers {'283e8f99-9b30-4e79-a84e-691b2bc0be7b'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:07.174121 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.174968 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] Sync routers for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:07.195013 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:07.195741 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.291863 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] Set router 283e8f99-9b30-4e79-a84e-691b2bc0be7b gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:07.298253 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks [] for router, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.304279 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks [] for router, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.342668 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:07.418865 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.423515 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.494165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Deleting port 3b9f5963-1c82-4a66-878b-8061c8718e60 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:07.494165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.513652 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185'}], 'enable_snat': True}, 'gw_port_id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:09:06Z', 'revision_number': 5, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port': {'id': '0a1f5c4d-24bf-459d-b08a-b93d56088c17', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:f9:a3:b2', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 333, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:02:26Z', 'updated_at': '2021-11-18T21:02:41Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.551305 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] Checking router: 283e8f99-9b30-4e79-a84e-691b2bc0be7b for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:07.562681 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] Routers {'283e8f99-9b30-4e79-a84e-691b2bc0be7b'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:07.563586 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.589170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] For port 3b9f5963-1c82-4a66-878b-8061c8718e60, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=3b9f5963-1c82-4a66-878b-8061c8718e60,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:07.589905 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.606135 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Calling delete_port for 3b9f5963-1c82-4a66-878b-8061c8718e60 owned by network:router_gateway {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:07.658655 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.664365 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] Set router 283e8f99-9b30-4e79-a84e-691b2bc0be7b gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:07.723173 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:09:07Z', 'revision_number': 6, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.758347 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a9fc4d54-c232-4dfa-a9bb-650910956360 None None] The sync data for ids ['283e8f99-9b30-4e79-a84e-691b2bc0be7b'] in dv-cinder-799871-8-iscsi is: [{'id': '283e8f99-9b30-4e79-a84e-691b2bc0be7b', 'name': 'tempest-TestShelveInstance-1362082646-router', 'tenant_id': '3af5bd8ced1f431281230f850c7e751c', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:02:24Z', 'updated_at': '2021-11-18T21:09:07Z', 'revision_number': 6, 'project_id': '3af5bd8ced1f431281230f850c7e751c', 'gw_port_host': None}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:07.760300 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213'}], 'enable_snat': True}, 'gw_port_id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:09:06Z', 'revision_number': 5, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port': {'id': '3b9f5963-1c82-4a66-878b-8061c8718e60', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:bb:52:ac', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'device_owner': 'network:router_gateway', 'standard_attr_id': 65, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.213', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:00:38Z', 'updated_at': '2021-11-18T21:00:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.796879 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Deleting port 0a1f5c4d-24bf-459d-b08a-b93d56088c17 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:07.797271 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.801853 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] Checking router: def0e3d1-c7be-4250-990a-3b6d3d56f9a0 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:07.812547 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] Routers {'def0e3d1-c7be-4250-990a-3b6d3d56f9a0'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:07.813171 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:07.826137 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.858342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Pushing event deleted for resources: {'Port': ['ID=3b9f5963-1c82-4a66-878b-8061c8718e60,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:07.889327 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] For port 0a1f5c4d-24bf-459d-b08a-b93d56088c17, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=0a1f5c4d-24bf-459d-b08a-b93d56088c17,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:07.889826 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.905544 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Calling delete_port for 0a1f5c4d-24bf-459d-b08a-b93d56088c17 owned by network:router_gateway {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:07.915393 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] Set router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 gateway port host: None {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:07.925226 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:07.978074 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:09:07Z', 'revision_number': 6, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:08.006708 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7c8b1403-e95b-49e9-91e9-cde22afaa895 None None] The sync data for ids ['def0e3d1-c7be-4250-990a-3b6d3d56f9a0'] in dv-cinder-799871-8-iscsi is: [{'id': 'def0e3d1-c7be-4250-990a-3b6d3d56f9a0', 'name': 'tempest-AttachVolumeShelveTestJSON-152130367-router', 'tenant_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:00:37Z', 'updated_at': '2021-11-18T21:09:07Z', 'revision_number': 6, 'project_id': 'd6128eda2acb42f3b896c4d4a809ed0e', 'gw_port_host': None}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:08.085369 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.114709 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Pushing event deleted for resources: {'Port': ['ID=0a1f5c4d-24bf-459d-b08a-b93d56088c17,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:08.187365 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.252432 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.285289 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.287519 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.316314 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.318469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.334319 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.334880 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Fanout notify agent at l3_agent the message router_deleted on router 283e8f99-9b30-4e79-a84e-691b2bc0be7b {{(pid=102670) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:09:08.340955 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.342118 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-5e077cee-c6ef-49cf-986b-55b6586bb22f admin admin] 10.222.0.61 "DELETE /v2.0/routers/283e8f99-9b30-4e79-a84e-691b2bc0be7b HTTP/1.1" status: 204 len: 168 time: 1.1817188 Nov 18 21:09:08.345500 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41284) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:08.366640 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.367491 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Fanout notify agent at l3_agent the message router_deleted on router def0e3d1-c7be-4250-990a-3b6d3d56f9a0 {{(pid=102669) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:09:08.373085 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.376689 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5235037b-5266-4601-8d3a-42a294006356 admin admin] 10.222.0.61 "DELETE /v2.0/routers/def0e3d1-c7be-4250-990a-3b6d3d56f9a0 HTTP/1.1" status: 204 len: 168 time: 1.2056787 Nov 18 21:09:08.376863 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41286) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:08.397130 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Deleting subnet 000d7d3c-2fa9-4900-aa84-42e72bfbb16b {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:09:08.400852 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.425592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Deleting subnet bc253697-be56-4044-aeb5-455225f5b7ab {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:09:08.429410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.436851 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.478629 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.529132 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.569848 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.605725 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.633402 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.634265 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Pushing event deleted for resources: {'Subnet': ['ID=000d7d3c-2fa9-4900-aa84-42e72bfbb16b,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:08.636299 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.641255 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c0a7b8df-56af-4ae4-b4ac-2401e73a7ddf admin admin] 10.222.0.61 "DELETE /v2.0/subnets/000d7d3c-2fa9-4900-aa84-42e72bfbb16b HTTP/1.1" status: 204 len: 168 time: 0.2942021 Nov 18 21:09:08.642009 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41288) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:08.644070 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-65f34e62-dec0-4ce1-8cbd-cdf769e90226 None None] Network 48c3801d-f9ea-49b1-bf8f-8043491d206f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:08.655731 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=bc253697-be56-4044-aeb5-455225f5b7ab,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:08.665966 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.669910 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-ed77dd77-3fe3-4f82-b456-5faad7b437e8 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/bc253697-be56-4044-aeb5-455225f5b7ab HTTP/1.1" status: 204 len: 168 time: 0.2919714 Nov 18 21:09:08.676731 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41290) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:08.699748 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-04764cdb-5ea3-42dd-a9f6-4a9337597879 None None] Network c212623b-e2b5-4f51-9cd5-a24f8a69f653 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:08.718600 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.750326 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.812866 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Deleting port 8db29542-8539-45cf-9b02-17e5c43fec0b {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:08.813203 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.826751 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Deleting port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:08.826969 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.907829 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] For port 8db29542-8539-45cf-9b02-17e5c43fec0b, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8db29542-8539-45cf-9b02-17e5c43fec0b,segment=NetworkSegment(89de1c6b-c41f-466f-9ac5-1885b681ff12),segment_id=89de1c6b-c41f-466f-9ac5-1885b681ff12)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:08.908163 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] For port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,segment=NetworkSegment(92b0e715-6270-4ec3-92fa-a68032c1ba37),segment_id=92b0e715-6270-4ec3-92fa-a68032c1ba37)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:08.908315 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.908592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:08.925589 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Calling delete_port for 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 owned by network:dhcp {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:08.926793 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Calling delete_port for 8db29542-8539-45cf-9b02-17e5c43fec0b owned by network:dhcp {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:09.018533 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.036673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.055280 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] No DVR routers for this DVR port 8db29542-8539-45cf-9b02-17e5c43fec0b on host dv-cinder-799871-8-iscsi {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:09:09.062392 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Pushing event deleted for resources: {'Port': ['ID=8db29542-8539-45cf-9b02-17e5c43fec0b,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:09.068450 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Pushing event deleted for resources: {'Port': ['ID=80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:09.070398 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] No DVR routers for this DVR port 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 on host dv-cinder-799871-8-iscsi {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:09:09.136224 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d062c073-2127-4a97-9aee-abfed3699196 None None] DHCP port deletion for 48c3801d-f9ea-49b1-bf8f-8043491d206f request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:09:09.158469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.171490 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.171685 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-464917c1-98a6-4c37-a137-bd2d93261178 None None] DHCP port deletion for c212623b-e2b5-4f51-9cd5-a24f8a69f653 request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:09:09.201449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c212623b-e2b5-4f51-9cd5-a24f8a69f653']}} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:09.208938 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['48c3801d-f9ea-49b1-bf8f-8043491d206f']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:09.219248 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '92b0e715-6270-4ec3-92fa-a68032c1ba37') {'for_net_delete': True} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:09.219576 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '92b0e715-6270-4ec3-92fa-a68032c1ba37') {} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:09.227849 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '89de1c6b-c41f-466f-9ac5-1885b681ff12') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:09.228766 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '89de1c6b-c41f-466f-9ac5-1885b681ff12') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:09.231426 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5774120'] for segment, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.246705 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.249397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.274667 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Releasing vlan 614 on physical network physnet1 to pool {{(pid=102669) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:09:09.275570 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5320355'] for segment, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: Traceback (most recent call last): Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: timer() Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: cb(*args, **kw) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: return func(*args, **kwargs) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: self._notify() Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: self.callback(batched_events) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: event.method(event) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: return f(self, *a, **k) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._get(url).json() Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: return self.request(url, 'GET', **kwargs) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:09:09.277774 dv-cinder-799871-8-iscsi neutron-server[102669]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:09:09.285590 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.297103 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Releasing vlan 641 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:09:09.297285 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device ae3c0e28-7521-44dd-b940-2b4e1c1ace76 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:09.297734 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:09:09.299687 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:09:09.322016 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: ae3c0e28-7521-44dd-b940-2b4e1c1ace76 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:09.322016 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device ae3c0e28-7521-44dd-b940-2b4e1c1ace76 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:09.364008 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.370401 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.373923 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] 10.222.0.61 "DELETE /v2.0/networks/48c3801d-f9ea-49b1-bf8f-8043491d206f HTTP/1.1" status: 204 len: 168 time: 0.7309580 Nov 18 21:09:09.378834 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.388708 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d397b7a-d8ae-4737-9f3b-0144f1bfdc1d admin admin] Pushing event deleted for resources: {'Network': ['ID=48c3801d-f9ea-49b1-bf8f-8043491d206f,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:09.389355 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.393971 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] 10.222.0.61 "DELETE /v2.0/networks/c212623b-e2b5-4f51-9cd5-a24f8a69f653 HTTP/1.1" status: 204 len: 168 time: 0.7159781 Nov 18 21:09:09.413150 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-56fceddc-8245-4ff3-9f9c-ec9593f302e1 admin admin] Pushing event deleted for resources: {'Network': ['ID=c212623b-e2b5-4f51-9cd5-a24f8a69f653,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:09.543740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41296) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:09.558306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41298) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:09.622359 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c1f113bc-3094-4e10-bc74-4ab41fc6296f admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d0f1cb43ab064a5388db98bf6b8228fa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0774171 Nov 18 21:09:09.625046 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41300) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:09.625863 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-ff8eeec2-68e7-4bb4-9af2-7dd09da91c84 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d6128eda2acb42f3b896c4d4a809ed0e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0665638 Nov 18 21:09:09.628358 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41302) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:09.679282 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-14ac0ba1-e30e-4da4-89c0-12b02f501b37 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.681887 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e9d27a6a-19cf-4db6-8f47-c70e0b86c2c4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.702936 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-14ac0ba1-e30e-4da4-89c0-12b02f501b37 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.708060 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e9d27a6a-19cf-4db6-8f47-c70e0b86c2c4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.753679 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-14ac0ba1-e30e-4da4-89c0-12b02f501b37 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.756759 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-14ac0ba1-e30e-4da4-89c0-12b02f501b37 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.757307 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e9d27a6a-19cf-4db6-8f47-c70e0b86c2c4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.758032 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-14ac0ba1-e30e-4da4-89c0-12b02f501b37 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/5d02163e-a02d-4546-ac53-2ec348989f18 HTTP/1.1" status: 204 len: 168 time: 0.1318762 Nov 18 21:09:09.760857 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e9d27a6a-19cf-4db6-8f47-c70e0b86c2c4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:09.762311 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e9d27a6a-19cf-4db6-8f47-c70e0b86c2c4 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8b6f53da-46a6-498b-85f0-a7f58334c536 HTTP/1.1" status: 204 len: 168 time: 0.1327381 Nov 18 21:09:09.770164 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14ac0ba1-e30e-4da4-89c0-12b02f501b37 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d02163e-a02d-4546-ac53-2ec348989f18,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:09.770690 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e9d27a6a-19cf-4db6-8f47-c70e0b86c2c4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8b6f53da-46a6-498b-85f0-a7f58334c536,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:09.929214 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:09.953961 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:09.954311 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 80c15e5d-2d5f-4ec6-afcb-e5fb5d07b103 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:09.954726 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8db29542-8539-45cf-9b02-17e5c43fec0b no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:09.976790 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 8db29542-8539-45cf-9b02-17e5c43fec0b {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:09.977149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8db29542-8539-45cf-9b02-17e5c43fec0b not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:09.977805 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device e140da03-4af4-43e2-8e18-8669d09e9d76 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:09.998955 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: e140da03-4af4-43e2-8e18-8669d09e9d76 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:09.999523 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device e140da03-4af4-43e2-8e18-8669d09e9d76 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:10.000131 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3b9f5963-1c82-4a66-878b-8061c8718e60 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:10.019427 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 3b9f5963-1c82-4a66-878b-8061c8718e60 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:10.020055 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 3b9f5963-1c82-4a66-878b-8061c8718e60 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:10.020674 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0a1f5c4d-24bf-459d-b08a-b93d56088c17 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:10.043212 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 0a1f5c4d-24bf-459d-b08a-b93d56088c17 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:10.043562 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 0a1f5c4d-24bf-459d-b08a-b93d56088c17 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:10.157165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41320) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:10.210910 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-67ffcfa6-104b-4cd6-b599-4b50e6b0e102 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3af5bd8ced1f431281230f850c7e751c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0525570 Nov 18 21:09:10.213877 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41322) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:10.270009 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-459ed58a-a533-4669-9c4b-0897076af706 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:10.294699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-459ed58a-a533-4669-9c4b-0897076af706 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:10.344760 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-459ed58a-a533-4669-9c4b-0897076af706 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:10.347678 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-459ed58a-a533-4669-9c4b-0897076af706 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:10.348856 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-459ed58a-a533-4669-9c4b-0897076af706 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2b25df98-1428-4de0-b937-40129e9239e0 HTTP/1.1" status: 204 len: 168 time: 0.1335337 Nov 18 21:09:10.357426 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-459ed58a-a533-4669-9c4b-0897076af706 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2b25df98-1428-4de0-b937-40129e9239e0,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:11.195339 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41368) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:11.297588 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1062322180-network', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:11.321176 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Made reservation on behalf of 97c605960c964eb3960a3f3324bf46bb for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:09:11.323407 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.333601 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.411415 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.416877 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.438744 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 639} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:09:11.454375 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd3be6fd-26cc-4b90-8aae-cf6e954e5bb3,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:11.457317 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.457658 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Added segment d8703035-b9e3-4e75-be30-8ad0a395f302 of type vlan for network e9895462-5764-4a81-a2a3-f5482f05a6a3 Nov 18 21:09:11.503271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.528873 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.529831 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:11.530406 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.606330 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 0.4092529 Nov 18 21:09:11.609077 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41384) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:11.613771 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Request body: {'subnet': {'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1062322180-subnet', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'ip_version': 4}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:11.628845 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f53d3d50-ce7c-46d2-9fd0-1c0151f35c3a admin admin] Pushing event updated for resources: {'Network': ['ID=e9895462-5764-4a81-a2a3-f5482f05a6a3,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:11.640646 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:09:11.643382 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Made reservation on behalf of 97c605960c964eb3960a3f3324bf46bb for: {'subnet': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:09:11.646185 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-5087316'] for subnet, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.825770 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5320202', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-5087302'] for subnet, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.891699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a8ffc170-cfa2-4b16-935a-923d6b39dd63,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:11.902101 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Checking segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:11.902468 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Network hostable DHCP agents. Network: e9895462-5764-4a81-a2a3-f5482f05a6a3, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102669) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:09:11.920633 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102669) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:09:11.929300 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, e9895462-5764-4a81-a2a3-f5482f05a6a3) {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:11.933671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:11.934344 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.939101 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5f1ca645-6fc1-493c-b7da-c322a10bd53f None None] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:11.952800 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-fc76d8d7-539e-4814-aa16-83d5ccc138c1 admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 0.3425624 Nov 18 21:09:11.954527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41386) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:11.963260 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:11.993833 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:11.994948 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.053649 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.111671 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-e9895462-5764-4a81-a2a3-f5482f05a6a3', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:09:12.112660 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.234401 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.299712 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Allocated IP 172.20.0.2 (e9895462-5764-4a81-a2a3-f5482f05a6a3/a8ffc170-cfa2-4b16-935a-923d6b39dd63/c68a60d7-a31c-4853-9da3-a5dcc9c758af) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:12.451549 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.462273 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.469221 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.472177 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.515391 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:12.519208 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Pushing event updated for resources: {'Port': ['ID=c68a60d7-a31c-4853-9da3-a5dcc9c758af,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:12.521653 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:12.524998 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:12.582765 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Allocated IP 172.27.3.149 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/7bd26ebf-504e-4ae0-bc44-3985411446ff) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:12.583048 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Attempting to bind port c68a60d7-a31c-4853-9da3-a5dcc9c758af on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:12.583221 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Attempting to bind port c68a60d7-a31c-4853-9da3-a5dcc9c758af by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:12.583557 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Attempting to bind port c68a60d7-a31c-4853-9da3-a5dcc9c758af on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:12.589074 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:12.589457 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Checking segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:12.589890 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.590289 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Bound using segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:12.590792 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Bound port: c68a60d7-a31c-4853-9da3-a5dcc9c758af, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:12.591248 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.670071 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] For port c68a60d7-a31c-4853-9da3-a5dcc9c758af, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:12.673783 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] For port c68a60d7-a31c-4853-9da3-a5dcc9c758af, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=c68a60d7-a31c-4853-9da3-a5dcc9c758af,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:12.679394 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.701741 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.733593 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb18aac5-e18e-4c74-bf6d-9815a5e7a87f None None] Pushing event updated for resources: {'Port': ['ID=c68a60d7-a31c-4853-9da3-a5dcc9c758af,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:12.739308 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:12.784889 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:12.788004 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:12.791918 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:12.822619 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Pushing event updated for resources: {'Port': ['ID=7bd26ebf-504e-4ae0-bc44-3985411446ff,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:13.150854 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:13.369685 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:13.511231 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Router defd8ebd-2dda-4655-92d4-b940e401ee36 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102670) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:09:13.621125 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:13.632449 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:13.641290 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:13.642553 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0d133f6d-535a-4c0f-bc1e-2182d62677ce admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 1.6866744 Nov 18 21:09:13.645405 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41400) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:13.652370 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:13.653672 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:13.764354 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:13.848150 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be908976-0d36-46aa-83df-2832c9a7d2e2 None None] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:13.985009 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:12Z', 'revision_number': 3, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:14.019296 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device c68a60d7-a31c-4853-9da3-a5dcc9c758af up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:14.025375 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:14.026015 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Updating router defd8ebd-2dda-4655-92d4-b940e401ee36 port 7bd26ebf-504e-4ae0-bc44-3985411446ff binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:09:14.052564 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.074672 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-d3a37576-3d59-46ec-b272-22c6df69af4d None None] Provisioning complete for port c68a60d7-a31c-4853-9da3-a5dcc9c758af triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:14.075044 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d3a37576-3d59-46ec-b272-22c6df69af4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.165414 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port c68a60d7-a31c-4853-9da3-a5dcc9c758af triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:14.166958 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.342424 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d3a37576-3d59-46ec-b272-22c6df69af4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.403854 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-d3a37576-3d59-46ec-b272-22c6df69af4d None None] For port c68a60d7-a31c-4853-9da3-a5dcc9c758af, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=c68a60d7-a31c-4853-9da3-a5dcc9c758af,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:14.417102 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d3a37576-3d59-46ec-b272-22c6df69af4d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.425342 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.427785 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.431485 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.434360 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.504829 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Attempting to bind port 7bd26ebf-504e-4ae0-bc44-3985411446ff on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:14.505305 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Attempting to bind port 7bd26ebf-504e-4ae0-bc44-3985411446ff by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:14.505851 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Attempting to bind port 7bd26ebf-504e-4ae0-bc44-3985411446ff on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:14.518693 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:14.519226 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:14.519726 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.520241 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:14.520889 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Bound port: 7bd26ebf-504e-4ae0-bc44-3985411446ff, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:14.521399 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.551437 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3a37576-3d59-46ec-b272-22c6df69af4d None None] Pushing event updated for resources: {'Port': ['ID=c68a60d7-a31c-4853-9da3-a5dcc9c758af,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:14.572027 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Pushing event updated for resources: {'Port': ['ID=7bd26ebf-504e-4ae0-bc44-3985411446ff,revision_number=2']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:14.585129 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.585516 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.585845 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.586372 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.586717 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.587057 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.587401 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.587843 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.588332 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.589038 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.589875 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.589875 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102672) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:14.590321 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.db.api [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102671) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 18 21:09:14.590643 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG oslo_db.api [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 18 21:09:14.591319 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-f4d0a9e3-b0bb-4eb0-89cf-5ef8db204ac0 None None] Provisioning complete for port c68a60d7-a31c-4853-9da3-a5dcc9c758af triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:14.591694 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f4d0a9e3-b0bb-4eb0-89cf-5ef8db204ac0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.598916 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] For port 7bd26ebf-504e-4ae0-bc44-3985411446ff, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:14.603054 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] For port 7bd26ebf-504e-4ae0-bc44-3985411446ff, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=7bd26ebf-504e-4ae0-bc44-3985411446ff,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:14.608212 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.646706 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Allocated IP 172.20.0.1 (e9895462-5764-4a81-a2a3-f5482f05a6a3/a8ffc170-cfa2-4b16-935a-923d6b39dd63/e894597e-82db-4b86-bae6-f4e25e75c247) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:14.686057 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:14.687457 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:14.824099 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.849218 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb19835b-4087-4a0d-8dc4-4e6ae401d926 None None] Pushing event updated for resources: {'Port': ['ID=7bd26ebf-504e-4ae0-bc44-3985411446ff,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:14.872409 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:14.920685 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:14.936703 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:14.941575 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:14.945082 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:14.977141 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Pushing event updated for resources: {'Port': ['ID=e894597e-82db-4b86-bae6-f4e25e75c247,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:14.995616 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.154496 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.160718 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:12Z', 'revision_number': 3, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:15.188895 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-97946bd6-e401-4732-847d-6321d98b6c70 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:12Z', 'revision_number': 3, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:14Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:15.266291 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-ed00a48f-f707-46ad-ae1d-30de30dadc53 None None] Provisioning complete for port e894597e-82db-4b86-bae6-f4e25e75c247 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:15.267127 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ed00a48f-f707-46ad-ae1d-30de30dadc53 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.310457 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-ed00a48f-f707-46ad-ae1d-30de30dadc53 None None] Port e894597e-82db-4b86-bae6-f4e25e75c247 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:15.365921 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.374321 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.453780 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Pushing event updated for resources: {'Port': ['ID=e894597e-82db-4b86-bae6-f4e25e75c247,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:15.456640 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.568932 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:15.570530 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:15.722672 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:15.844940 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-502fc79f-1211-4024-9939-907153e3cc6e None None] Provisioning complete for port e894597e-82db-4b86-bae6-f4e25e75c247 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:15.845659 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-502fc79f-1211-4024-9939-907153e3cc6e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:15.866356 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:15.882076 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6d274122-4cdd-4a4c-9243-38afa3f8c2e1 admin admin] 10.222.0.61 "PUT /v2.0/routers/defd8ebd-2dda-4655-92d4-b940e401ee36/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2356648 Nov 18 21:09:15.884704 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-502fc79f-1211-4024-9939-907153e3cc6e None None] Port e894597e-82db-4b86-bae6-f4e25e75c247 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:16.024529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 7bd26ebf-504e-4ae0-bc44-3985411446ff up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:16.104590 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 7bd26ebf-504e-4ae0-bc44-3985411446ff triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:16.106960 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.218743 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.242869 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port 7bd26ebf-504e-4ae0-bc44-3985411446ff, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=7bd26ebf-504e-4ae0-bc44-3985411446ff,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:16.247817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.248869 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device c68a60d7-a31c-4853-9da3-a5dcc9c758af up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:16.328144 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=7bd26ebf-504e-4ae0-bc44-3985411446ff,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:16.342558 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port c68a60d7-a31c-4853-9da3-a5dcc9c758af triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:16.342927 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.531467 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41440) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:16.536551 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-343507265-network', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:16.561100 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Made reservation on behalf of d704a5aca34847afa350e7c00eaffb32 for: {'network': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:09:16.564631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for network, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.575911 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.659555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.664812 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.692697 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 615} {{(pid=102669) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 18 21:09:16.704161 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=56d4323a-4844-4eb2-aa8d-f9da5ba3d38d,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:16.709268 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.709609 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.segments_db [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Added segment 0e18f24a-fa22-4271-b748-71897099ca75 of type vlan for network 29171ce5-2b7b-472e-a1ff-f433c192f19f Nov 18 21:09:16.754318 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8748165000708'] for network, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.783535 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368'] for network, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.784619 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:16.785201 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:16.843681 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] 10.222.0.61 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.3085494 Nov 18 21:09:16.844034 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41442) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:16.851023 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Request body: {'subnet': {'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-343507265-subnet', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'ip_version': 4}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:16.856949 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-83e27ccb-0b49-4e94-9f27-6d140261663e admin admin] Pushing event updated for resources: {'Network': ['ID=29171ce5-2b7b-472e-a1ff-f433c192f19f,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:16.868837 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f details requested by agent ovs-agent-dv-cinder-799871-8-iscsi with host dv-cinder-799871-8-iscsi {{(pid=102671) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 18 21:09:16.874037 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Made reservation on behalf of d704a5aca34847afa350e7c00eaffb32 for: {'subnet': 1} {{(pid=102670) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:09:16.876673 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-6003637'] for subnet, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.070145 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-5840016', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-6003623'] for subnet, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.096230 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:17.108632 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:17.109323 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:17.139366 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Pushing event updated for resources: {'Subnet': ['ID=5942750d-1edf-4991-961b-07e7165d1801,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:17.147246 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Checking segment: {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102670) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:17.147618 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Network hostable DHCP agents. Network: 29171ce5-2b7b-472e-a1ff-f433c192f19f, hostable agents: ['78d2bd35-89ca-4648-bb2d-abedbbf81e8d'], hosted agents: [] {{(pid=102670) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 18 21:09:17.174222 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f is scheduled to be hosted by DHCP agent 78d2bd35-89ca-4648-bb2d-abedbbf81e8d with binding_index 1 {{(pid=102670) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 18 21:09:17.189433 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-799871-8-iscsi, 29171ce5-2b7b-472e-a1ff-f433c192f19f) {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:17.194954 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:17.196404 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.204760 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa8a12bd-31b7-4d43-a897-8834d06d994c None None] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:17.213608 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-bdb0292e-e011-482a-a019-3f87e1b5421f admin admin] 10.222.0.61 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.3676155 Nov 18 21:09:17.216359 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41448) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:17.221340 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:17.249900 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1015038', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-24748'] for router, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.249900 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1011822', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1025471', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-862663', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-27487'] for router, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.292074 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:17.313796 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.460222 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.502817 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcpffbc23b1-0154-5809-ae9b-acaa6b119159-29171ce5-2b7b-472e-a1ff-f433c192f19f', 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'fixed_ips': [{'subnet_id': '5942750d-1edf-4991-961b-07e7165d1801'}]}} from dv-cinder-799871-8-iscsi. {{(pid=102671) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 18 21:09:17.503612 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.670501 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.692333 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.707728 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.db_base_plugin_common [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Allocated IP 172.20.0.2 (29171ce5-2b7b-472e-a1ff-f433c192f19f/5942750d-1edf-4991-961b-07e7165d1801/8dd4eae7-d540-4139-93fa-78e99e88f03f) {{(pid=102671) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:17.712761 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 2, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:17.747149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:17.747575 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Updating router defd8ebd-2dda-4655-92d4-b940e401ee36 port e894597e-82db-4b86-bae6-f4e25e75c247 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:09:17.811361 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Allocated IP 172.27.3.244 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/dd06c76e-968c-4d35-89e1-317e3bf09ec0) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:17.819810 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.924129 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.961511 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:17.974193 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 7bd26ebf-504e-4ae0-bc44-3985411446ff up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:18.013552 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:18.016755 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:18.020264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:18.026423 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Pushing event updated for resources: {'Port': ['ID=dd06c76e-968c-4d35-89e1-317e3bf09ec0,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:18.077783 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Publish callbacks [] for port, precommit_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.123373 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574'] for port, after_create {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.194151 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f is already hosted by enough agents. {{(pid=102671) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:18.207169 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 7bd26ebf-504e-4ae0-bc44-3985411446ff triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:18.207538 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.209551 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.scheduler.base_scheduler [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Resources bound (agent type, host, resource id): {{(pid=102671) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:18.212314 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Received port after_create {{(pid=102671) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:18.241532 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Pushing event updated for resources: {'Port': ['ID=8dd4eae7-d540-4139-93fa-78e99e88f03f,revision_number=1']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:18.310201 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.492338 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Attempting to bind port 8dd4eae7-d540-4139-93fa-78e99e88f03f on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:18.493199 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Attempting to bind port 8dd4eae7-d540-4139-93fa-78e99e88f03f by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:18.493573 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Attempting to bind port 8dd4eae7-d540-4139-93fa-78e99e88f03f on network 29171ce5-2b7b-472e-a1ff-f433c192f19f {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:18.517355 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:18.518080 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Checking segment: {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:18.518257 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.518652 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Bound using segment: {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:18.519131 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Bound port: 8dd4eae7-d540-4139-93fa-78e99e88f03f, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:18.519604 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.541073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1011831', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1025512'] for router, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.604831 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.621367 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.676215 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 is scheduled to L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 with binding_index 1 {{(pid=102669) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 18 21:09:18.690461 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] For port 8dd4eae7-d540-4139-93fa-78e99e88f03f, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:18.696901 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] For port 8dd4eae7-d540-4139-93fa-78e99e88f03f, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8dd4eae7-d540-4139-93fa-78e99e88f03f,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:18.705692 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.707761 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24602118-8906-49a7-b229-78c9b0169011 None None] Pushing event updated for resources: {'Port': ['ID=e894597e-82db-4b86-bae6-f4e25e75c247,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:18.810141 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:18.823685 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Sync routers for ids ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:18.825823 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Attempting to bind port e894597e-82db-4b86-bae6-f4e25e75c247 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:18.826577 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Attempting to bind port e894597e-82db-4b86-bae6-f4e25e75c247 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:18.827122 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Attempting to bind port e894597e-82db-4b86-bae6-f4e25e75c247 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:18.832730 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:18.833114 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Checking segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:18.834106 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.834271 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Bound using segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:18.834641 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Bound port: e894597e-82db-4b86-bae6-f4e25e75c247, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:18.835276 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.838347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be43e700-c5c7-4e0e-83cb-2e5e0857eb3d None None] Pushing event updated for resources: {'Port': ['ID=8dd4eae7-d540-4139-93fa-78e99e88f03f,revision_number=2']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:18.851501 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Routers {'8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:18.852941 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:18.859454 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:18.863258 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1b5d3a64-ac01-4762-b31c-a5420b223164 admin admin] 10.222.0.61 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 1.6431122 Nov 18 21:09:18.863496 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41454) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:18.931318 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] For port e894597e-82db-4b86-bae6-f4e25e75c247, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:18.937030 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] For port e894597e-82db-4b86-bae6-f4e25e75c247, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=e894597e-82db-4b86-bae6-f4e25e75c247,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:18.945483 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.011015 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:19.011769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:19.029271 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Set router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:19.100309 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-24602118-8906-49a7-b229-78c9b0169011 None None] Pushing event updated for resources: {'Port': ['ID=e894597e-82db-4b86-bae6-f4e25e75c247,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:19.126296 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Provisioning complete for port e894597e-82db-4b86-bae6-f4e25e75c247 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:19.126950 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.253867 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:19.369949 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:18Z', 'revision_number': 3, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:17Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:19.403502 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Checking router: 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:19.404093 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Updating router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 port dd06c76e-968c-4d35-89e1-317e3bf09ec0 binding host dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:09:19.432553 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.517942 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.524012 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.529943 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.568352 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] For port e894597e-82db-4b86-bae6-f4e25e75c247, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=e894597e-82db-4b86-bae6-f4e25e75c247,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:19.575218 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.615208 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:18Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:19.653223 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-481bb01e-1ab8-4b39-a915-7212ce729020 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:18Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:19.669909 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Pushing event updated for resources: {'Port': ['ID=e894597e-82db-4b86-bae6-f4e25e75c247,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:19.684252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.684622 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.684952 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.685289 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.685632 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.685968 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.686298 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.686642 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.686965 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.687293 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.687621 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.687948 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-34d55ea8-9a10-4603-a45e-c568c44725be None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:09:19.781329 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-829ae3dc-bb45-48b8-ab74-d5ea34ad19cd None None] Provisioning complete for port e894597e-82db-4b86-bae6-f4e25e75c247 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:19.781972 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-829ae3dc-bb45-48b8-ab74-d5ea34ad19cd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.865766 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Allocated IP 172.20.0.1 (29171ce5-2b7b-472e-a1ff-f433c192f19f/5942750d-1edf-4991-961b-07e7165d1801/141ed927-8ee9-4f96-9375-4e50e1de01e6) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:19.899800 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Publish callbacks [] for port, precommit_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:19.910014 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.010996 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Attempting to bind port dd06c76e-968c-4d35-89e1-317e3bf09ec0 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:20.011815 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Attempting to bind port dd06c76e-968c-4d35-89e1-317e3bf09ec0 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:20.012635 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Attempting to bind port dd06c76e-968c-4d35-89e1-317e3bf09ec0 on network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:20.024244 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:20.025467 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Checking segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102672) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:20.026069 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.026655 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Bound using segment: {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'} {{(pid=102672) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:20.028320 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.managers [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Bound port: dd06c76e-968c-4d35-89e1-317e3bf09ec0, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'bc9325a4-1103-4504-96f0-c02c30f29de6', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}}] {{(pid=102672) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:20.028998 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.075931 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d58fc8-2715-4294-95cd-750f60395892 None None] Pushing event updated for resources: {'Port': ['ID=dd06c76e-968c-4d35-89e1-317e3bf09ec0,revision_number=2']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:20.114593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.140402 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] For port dd06c76e-968c-4d35-89e1-317e3bf09ec0, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102672) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:20.151742 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.plugins.ml2.db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] For port dd06c76e-968c-4d35-89e1-317e3bf09ec0, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=dd06c76e-968c-4d35-89e1-317e3bf09ec0,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102672) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:20.153980 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device e894597e-82db-4b86-bae6-f4e25e75c247 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:20.158372 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron_lib.callbacks.manager [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102672) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.185288 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.234776 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34d58fc8-2715-4294-95cd-750f60395892 None None] Pushing event updated for resources: {'Port': ['ID=dd06c76e-968c-4d35-89e1-317e3bf09ec0,revision_number=3']} {{(pid=102672) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:20.274604 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Routers {'8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:20.275267 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:20.277350 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port e894597e-82db-4b86-bae6-f4e25e75c247 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:20.277921 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.312934 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-30cf38e3-8d1c-4838-bc5c-8eb39eac7caf None None] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:09:20.411061 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] Set router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:20.422394 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-ae8a6a4c-0e96-4d8c-8ccd-2a81272cc62e None None] Provisioning complete for port 8dd4eae7-d540-4139-93fa-78e99e88f03f triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:20.422863 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ae8a6a4c-0e96-4d8c-8ccd-2a81272cc62e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.569146 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8dd4eae7-d540-4139-93fa-78e99e88f03f up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:20.599418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:20.603052 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:20.609302 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:20.647513 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1014207'] for router_interface, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.659990 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:18Z', 'revision_number': 3, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:20.660297 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ae8a6a4c-0e96-4d8c-8ccd-2a81272cc62e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.696530 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e1ad09a4-e109-4083-b6fe-87b6294febc3 None None] The sync data for ids ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'] in dv-cinder-799871-8-iscsi is: [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:18Z', 'revision_number': 3, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:20.702436 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Pushing event updated for resources: {'Port': ['ID=141ed927-8ee9-4f96-9375-4e50e1de01e6,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:20.730924 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-ae8a6a4c-0e96-4d8c-8ccd-2a81272cc62e None None] For port 8dd4eae7-d540-4139-93fa-78e99e88f03f, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8dd4eae7-d540-4139-93fa-78e99e88f03f,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:20.744330 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ae8a6a4c-0e96-4d8c-8ccd-2a81272cc62e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.746083 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 8dd4eae7-d540-4139-93fa-78e99e88f03f triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:20.746440 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.821316 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:20.864236 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae8a6a4c-0e96-4d8c-8ccd-2a81272cc62e None None] Pushing event updated for resources: {'Port': ['ID=8dd4eae7-d540-4139-93fa-78e99e88f03f,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:21.177772 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-131a06a2-c9e6-46ad-af1a-8c3c39867b7f None None] Provisioning complete for port 141ed927-8ee9-4f96-9375-4e50e1de01e6 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:21.178165 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-131a06a2-c9e6-46ad-af1a-8c3c39867b7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.182831 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.197864 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.256659 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-131a06a2-c9e6-46ad-af1a-8c3c39867b7f None None] Port 141ed927-8ee9-4f96-9375-4e50e1de01e6 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:21.289138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-131a06a2-c9e6-46ad-af1a-8c3c39867b7f None None] Provisioning complete for port 8dd4eae7-d540-4139-93fa-78e99e88f03f triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:21.289970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-131a06a2-c9e6-46ad-af1a-8c3c39867b7f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.339971 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Pushing event updated for resources: {'Port': ['ID=141ed927-8ee9-4f96-9375-4e50e1de01e6,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:21.363088 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-635358', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1015599'] for router_interface, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.564748 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:21.566671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:21.593138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-4f526160-c177-47ae-8913-0c9e9a6587e3 None None] Provisioning complete for port 141ed927-8ee9-4f96-9375-4e50e1de01e6 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:21.593755 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-4f526160-c177-47ae-8913-0c9e9a6587e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.648232 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-4f526160-c177-47ae-8913-0c9e9a6587e3 None None] Port 141ed927-8ee9-4f96-9375-4e50e1de01e6 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:21.717256 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:21.856697 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:21.864167 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-44bc43c5-4d0b-4c31-8865-5335ee063487 admin admin] 10.222.0.61 "PUT /v2.0/routers/8e7652c0-bf6b-4dfc-99eb-ed46cb070a41/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9971821 Nov 18 21:09:21.882099 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-d13dd7df-1f0e-4800-a59c-f274233ef0c7 None None] Provisioning complete for port 141ed927-8ee9-4f96-9375-4e50e1de01e6 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:21.882758 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-d13dd7df-1f0e-4800-a59c-f274233ef0c7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:21.887246 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9679260f-990e-4d01-84fc-b519a811aff9 req-732dff7f-d4ce-4635-9851-608bb72540d9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:21.899609 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9679260f-990e-4d01-84fc-b519a811aff9 req-732dff7f-d4ce-4635-9851-608bb72540d9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.1037796 Nov 18 21:09:21.947711 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-d13dd7df-1f0e-4800-a59c-f274233ef0c7 None None] Port 141ed927-8ee9-4f96-9375-4e50e1de01e6 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:21.962422 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9679260f-990e-4d01-84fc-b519a811aff9 req-ebfc2b9f-abcb-4423-b237-5c27e254388c tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0609508 Nov 18 21:09:22.056082 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8dd4eae7-d540-4139-93fa-78e99e88f03f up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:22.127732 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 8dd4eae7-d540-4139-93fa-78e99e88f03f triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:22.128239 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.225939 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device dd06c76e-968c-4d35-89e1-317e3bf09ec0 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:22.278501 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port dd06c76e-968c-4d35-89e1-317e3bf09ec0 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:22.278845 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.502168 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.529517 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] For port dd06c76e-968c-4d35-89e1-317e3bf09ec0, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=dd06c76e-968c-4d35-89e1-317e3bf09ec0,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:22.533889 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.592750 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Pushing event updated for resources: {'Port': ['ID=dd06c76e-968c-4d35-89e1-317e3bf09ec0,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:22.648961 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41520) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:22.653927 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1633191489', 'description': 'tempest-secgroup-smoke-1633191489 description', 'project_id': '97c605960c964eb3960a3f3324bf46bb'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:22.677681 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.750842 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.755922 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.790408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.791694 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 0.1416054 Nov 18 21:09:22.794235 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9bd643a-d28e-444d-9580-84c693058556 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroup': ['ID=05581fc3-f5ff-492a-8f7f-0d168cec3421,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:22.794767 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41522) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:22.800162 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group_rule': {'security_group_id': '05581fc3-f5ff-492a-8f7f-0d168cec3421', 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:22.843555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.909647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.915587 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.927459 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41526) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:22.935606 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1f92e6e9-ba6c-4a19-969b-71c417c429ab,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:22.948227 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:22.949070 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-8bfbada7-b058-47a5-a883-50d76facce7c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1532066 Nov 18 21:09:22.956283 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41530) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:22.960845 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group_rule': {'security_group_id': '05581fc3-f5ff-492a-8f7f-0d168cec3421', 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:23.000339 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.074374 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-19d8805a-1d56-47d9-b9d9-1245400ac749 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.111816 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.123625 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.163648 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a85caeea-1e6e-4e4a-9450-791c3b5b80f6 req-262815e5-2ee6-453a-a680-3a7fd5d6677f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:23.165771 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a85caeea-1e6e-4e4a-9450-791c3b5b80f6 req-262815e5-2ee6-453a-a680-3a7fd5d6677f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.1218603 Nov 18 21:09:23.171234 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2cbe33c2-7f87-4cce-b95f-aefec1b12e8c,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.179358 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.180630 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-6ed521c8-1cc3-4caf-8be1-e51fe2cb0fe1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.2233438 Nov 18 21:09:23.183404 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41536) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:23.188746 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group_rule': {'security_group_id': '05581fc3-f5ff-492a-8f7f-0d168cec3421', 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:23.227416 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.235271 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Sync routers for ids ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:23.254154 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Routers {'8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:23.255082 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:23.263868 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a85caeea-1e6e-4e4a-9450-791c3b5b80f6 req-5ace79d0-33cc-43d0-8071-7cc146802f1e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0884409 Nov 18 21:09:23.268476 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-19d8805a-1d56-47d9-b9d9-1245400ac749 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.275849 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-19d8805a-1d56-47d9-b9d9-1245400ac749 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.314594 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.320335 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.325384 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-19d8805a-1d56-47d9-b9d9-1245400ac749 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=48f6b3415bff4eb1abdd8a4087733098&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3957167 Nov 18 21:09:23.328195 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41538) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:23.338076 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19d8805a-1d56-47d9-b9d9-1245400ac749 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bdecb3fa-3b5c-4539-b0dc-cd334142e023,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.342143 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8ac2b74a-d103-4637-a2e8-bb0a8257018a,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.355543 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.356931 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-078258e4-d426-4f3e-bd11-cf1f87ee09c8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1725032 Nov 18 21:09:23.359736 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41540) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:23.365139 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group_rule': {'security_group_id': '05581fc3-f5ff-492a-8f7f-0d168cec3421', 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:23.395363 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Set router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:23.426736 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.431485 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ba009547-e016-4ea0-98ea-e573e16046ff admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.476061 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ba009547-e016-4ea0-98ea-e573e16046ff admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.521222 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.526765 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.554524 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=926e68b5-48fa-422c-9427-20a03aa31c5a,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.561099 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ba009547-e016-4ea0-98ea-e573e16046ff admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.563754 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ba009547-e016-4ea0-98ea-e573e16046ff admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.565301 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ba009547-e016-4ea0-98ea-e573e16046ff admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/bdecb3fa-3b5c-4539-b0dc-cd334142e023 HTTP/1.1" status: 204 len: 168 time: 0.2357888 Nov 18 21:09:23.572690 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.574167 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-583be329-0bac-4a5b-bde2-0e38fec64856 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.2132053 Nov 18 21:09:23.578619 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41544) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:23.579778 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba009547-e016-4ea0-98ea-e573e16046ff admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bdecb3fa-3b5c-4539-b0dc-cd334142e023,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.583847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group_rule': {'security_group_id': '05581fc3-f5ff-492a-8f7f-0d168cec3421', 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:23.613139 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.securitygroups_db [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Project 97c605960c964eb3960a3f3324bf46bb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 21:09:23.625007 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.641641 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:20Z', 'revision_number': 4, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '141ed927-8ee9-4f96-9375-4e50e1de01e6', 'name': '', 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'mac_address': 'fa:16:3e:c8:ad:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_interface', 'standard_attr_id': 561, 'fixed_ips': [{'subnet_id': '5942750d-1edf-4991-961b-07e7165d1801', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:19Z', 'updated_at': '2021-11-18T21:09:20Z', 'revision_number': 2, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'subnets': [{'id': '5942750d-1edf-4991-961b-07e7165d1801', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:23.669470 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Checking router: 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:23.669824 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Updating router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 port 141ed927-8ee9-4f96-9375-4e50e1de01e6 binding host dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 18 21:09:23.696001 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.698097 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.704028 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.734770 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.734770 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.1545045 Nov 18 21:09:23.737442 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41548) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:23.742161 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'security_group_rule': {'security_group_id': '05581fc3-f5ff-492a-8f7f-0d168cec3421', 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:23.755483 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c8febf-e46a-4e94-abba-510a4c67fd55 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0aed8732-45d1-4bf0-b096-bb9fd0f2a434,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.778090 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.securitygroups_db [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Project 97c605960c964eb3960a3f3324bf46bb added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 18 21:09:23.783491 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.847595 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.854533 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.884856 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e911c36b-4ea7-4558-8483-cb801749bce8,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:23.898286 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:23.900669 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-42c98edc-4156-4f25-a543-f0b8a0ab5e6a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.1621671 Nov 18 21:09:23.973994 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41564) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:23.993206 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device dd06c76e-968c-4d35-89e1-317e3bf09ec0 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:24.001611 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-70b02ece-e611-43c5-b5a5-517d4dafd2cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.099601 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Publish callbacks [] for port, precommit_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.100081 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-70b02ece-e611-43c5-b5a5-517d4dafd2cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.103367 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port dd06c76e-968c-4d35-89e1-317e3bf09ec0 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:24.103748 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.106597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-70b02ece-e611-43c5-b5a5-517d4dafd2cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.127531 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.158106 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-4372f163-acf7-4e67-b64b-3a2082a6b829 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:24.160533 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-4372f163-acf7-4e67-b64b-3a2082a6b829 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0744712 Nov 18 21:09:24.167699 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-70b02ece-e611-43c5-b5a5-517d4dafd2cd admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=2cc9dd0a5ae94148982218ba6170fad2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1918390 Nov 18 21:09:24.168717 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70b02ece-e611-43c5-b5a5-517d4dafd2cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7f7919b0-e76f-40b2-8951-1801031b02bd,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:24.170342 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41594) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:24.210548 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58489f88-b4de-4e81-9a87-e1f3e6d6abea None None] Pushing event updated for resources: {'Port': ['ID=141ed927-8ee9-4f96-9375-4e50e1de01e6,revision_number=3']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:24.297718 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Attempting to bind port 141ed927-8ee9-4f96-9375-4e50e1de01e6 on host dv-cinder-799871-8-iscsi for vnic_type normal with profile {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:24.298452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Attempting to bind port 141ed927-8ee9-4f96-9375-4e50e1de01e6 by drivers openvswitch,hyperv on host dv-cinder-799871-8-iscsi at level 0 using segments [{'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:24.298452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Attempting to bind port 141ed927-8ee9-4f96-9375-4e50e1de01e6 on network 29171ce5-2b7b-472e-a1ff-f433c192f19f {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:24.303243 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b6b05df-3653-45ea-83fe-05fc2633a92d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.311445 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Checking agent: {'id': 'ab299486-59d8-4077-b9ee-70fa8772864b', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-799871-8-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 53, 8), 'started_at': datetime.datetime(2021, 11, 18, 20, 53, 38), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 8), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-799871-8-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:24.311827 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Checking segment: {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102671) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:24.312301 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.312656 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Bound using segment: {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'} {{(pid=102671) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:24.313160 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.managers [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Bound port: 141ed927-8ee9-4f96-9375-4e50e1de01e6, host: dv-cinder-799871-8-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0e18f24a-fa22-4271-b748-71897099ca75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 615, 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f'}}] {{(pid=102671) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:24.313529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.374808 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b6b05df-3653-45ea-83fe-05fc2633a92d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.402267 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] For port 141ed927-8ee9-4f96-9375-4e50e1de01e6, host dv-cinder-799871-8-iscsi, cleared binding levels {{(pid=102671) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:24.412126 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] For port 141ed927-8ee9-4f96-9375-4e50e1de01e6, host dv-cinder-799871-8-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=141ed927-8ee9-4f96-9375-4e50e1de01e6,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102671) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:24.418250 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.474095 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce437668-8a1d-4719-83d5-1ee3ec8f35bf req-83a153fb-e146-45f1-857b-b1dfa5bbd069 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:24.476227 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ce437668-8a1d-4719-83d5-1ee3ec8f35bf req-83a153fb-e146-45f1-857b-b1dfa5bbd069 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 946 time: 0.0978582 Nov 18 21:09:24.479744 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Deleting port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:24.486552 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.511413 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Routers {'8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:24.513176 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:24.572300 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58489f88-b4de-4e81-9a87-e1f3e6d6abea None None] Pushing event updated for resources: {'Port': ['ID=141ed927-8ee9-4f96-9375-4e50e1de01e6,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:24.584873 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b6b05df-3653-45ea-83fe-05fc2633a92d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.588785 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1b6b05df-3653-45ea-83fe-05fc2633a92d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.592187 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1b6b05df-3653-45ea-83fe-05fc2633a92d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/7f7919b0-e76f-40b2-8951-1801031b02bd HTTP/1.1" status: 204 len: 168 time: 0.4169385 Nov 18 21:09:24.612978 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1b6b05df-3653-45ea-83fe-05fc2633a92d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7f7919b0-e76f-40b2-8951-1801031b02bd,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:24.657095 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-aedf52e2-4bec-47fa-a826-ee8ab07964e2 None None] Provisioning complete for port 141ed927-8ee9-4f96-9375-4e50e1de01e6 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:24.658014 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aedf52e2-4bec-47fa-a826-ee8ab07964e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.662798 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ce437668-8a1d-4719-83d5-1ee3ec8f35bf req-0a020851-993e-479e-abf0-6d287345d64e tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=4b2913ed-86b0-4587-843f-c453f93f79f4&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1647868 Nov 18 21:09:24.723914 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] For port 9f8d85f0-073b-4d3b-b9e3-f904463e7647, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=9f8d85f0-073b-4d3b-b9e3-f904463e7647,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:24.725748 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.750364 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] Set router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:24.842589 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aedf52e2-4bec-47fa-a826-ee8ab07964e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.957064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-aedf52e2-4bec-47fa-a826-ee8ab07964e2 None None] For port 141ed927-8ee9-4f96-9375-4e50e1de01e6, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=141ed927-8ee9-4f96-9375-4e50e1de01e6,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:24.962511 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-aedf52e2-4bec-47fa-a826-ee8ab07964e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.979866 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.980296 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:24.980629 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Floating IP 8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84 disassociated. External IP: 172.27.3.31, port: 9f8d85f0-073b-4d3b-b9e3-f904463e7647. Nov 18 21:09:24.980980 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Calling delete_port for 9f8d85f0-073b-4d3b-b9e3-f904463e7647 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:25.038252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aedf52e2-4bec-47fa-a826-ee8ab07964e2 None None] Pushing event updated for resources: {'Port': ['ID=141ed927-8ee9-4f96-9375-4e50e1de01e6,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:25.099910 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-33b37012-a587-491a-9d8b-031f4ea6ee83 None None] Provisioning complete for port 141ed927-8ee9-4f96-9375-4e50e1de01e6 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:25.100391 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-33b37012-a587-491a-9d8b-031f4ea6ee83 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:25.170571 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:20Z', 'revision_number': 4, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '141ed927-8ee9-4f96-9375-4e50e1de01e6', 'name': '', 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'mac_address': 'fa:16:3e:c8:ad:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_interface', 'standard_attr_id': 561, 'fixed_ips': [{'subnet_id': '5942750d-1edf-4991-961b-07e7165d1801', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:19Z', 'updated_at': '2021-11-18T21:09:24Z', 'revision_number': 4, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'subnets': [{'id': '5942750d-1edf-4991-961b-07e7165d1801', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:25.183612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:25.209700 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c7cec57e-f25b-4cfa-81d2-f7b362645bbb None None] The sync data for ids ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'] in dv-cinder-799871-8-iscsi is: [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:20Z', 'revision_number': 4, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '141ed927-8ee9-4f96-9375-4e50e1de01e6', 'name': '', 'network_id': '29171ce5-2b7b-472e-a1ff-f433c192f19f', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'mac_address': 'fa:16:3e:c8:ad:7c', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_interface', 'standard_attr_id': 561, 'fixed_ips': [{'subnet_id': '5942750d-1edf-4991-961b-07e7165d1801', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:19Z', 'updated_at': '2021-11-18T21:09:24Z', 'revision_number': 4, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'subnets': [{'id': '5942750d-1edf-4991-961b-07e7165d1801', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:25.221813 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event deleted for resources: {'Port': ['ID=9f8d85f0-073b-4d3b-b9e3-f904463e7647,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:25.388693 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:25.546031 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:25.572232 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:25.604636 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:25.605527 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:25.629242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] No DVR routers for this DVR port 9f8d85f0-073b-4d3b-b9e3-f904463e7647 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:09:25.632181 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:25.637262 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-785dd344-2e20-4feb-bff0-40c8cdf863f9 req-7e017cbe-998b-4ed4-8051-0fb1aa2aa6c8 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "DELETE /v2.0/ports/9f8d85f0-073b-4d3b-b9e3-f904463e7647 HTTP/1.1" status: 204 len: 173 time: 1.4692106 Nov 18 21:09:25.637801 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'name': 'network-vif-deleted', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:09:25.645929 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-44d5e539-7782-4be2-921a-40b7491f3678" -d '{"events": [{"server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "name": "network-vif-deleted", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:09:25.745187 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:09:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c430c2dc-e9a6-403f-87ed-3553eb3dc549 x-openstack-request-id: req-c430c2dc-e9a6-403f-87ed-3553eb3dc549 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:09:25.746591 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "1c058e3d-74c5-4946-89e0-0226bce312fd", "name": "network-vif-deleted", "tag": "9f8d85f0-073b-4d3b-b9e3-f904463e7647", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:09:25.747252 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c430c2dc-e9a6-403f-87ed-3553eb3dc549 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:09:25.747906 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '1c058e3d-74c5-4946-89e0-0226bce312fd', 'name': 'network-vif-deleted', 'tag': '9f8d85f0-073b-4d3b-b9e3-f904463e7647', 'status': 'completed', 'code': 200} Nov 18 21:09:25.832023 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-24d4ffce-4896-4739-ad1f-1c10ccf39211 req-abe13689-159d-472d-a7c1-90fbacc2c36f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=1c058e3d-74c5-4946-89e0-0226bce312fd HTTP/1.1" status: 200 len: 210 time: 0.0593576 Nov 18 21:09:25.981019 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:26.012661 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 141ed927-8ee9-4f96-9375-4e50e1de01e6 up at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:26.084990 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Provisioning complete for port 141ed927-8ee9-4f96-9375-4e50e1de01e6 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:26.085443 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:26.302855 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:26.338881 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:26.348148 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:26.348781 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:26.484154 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:26.735302 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:26.763179 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d0f3714d-b7b5-4897-b77f-407f6e9eda87 None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:26.943827 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41674) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:27.026410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf077a8-a577-4d05-96d1-d443a395a35d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.054808 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf077a8-a577-4d05-96d1-d443a395a35d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.116723 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf077a8-a577-4d05-96d1-d443a395a35d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.124944 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-acf077a8-a577-4d05-96d1-d443a395a35d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.126536 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-acf077a8-a577-4d05-96d1-d443a395a35d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "DELETE /v2.0/security-groups/4b2913ed-86b0-4587-843f-c453f93f79f4 HTTP/1.1" status: 204 len: 168 time: 0.1812410 Nov 18 21:09:27.129738 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41676) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:27.139405 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-acf077a8-a577-4d05-96d1-d443a395a35d tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b2913ed-86b0-4587-843f-c453f93f79f4,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:27.158453 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.api.v2.resource [None req-2a1993d0-709c-4521-82ca-2c50bf145ff5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] show failed (client error): The resource could not be found. Nov 18 21:09:27.159881 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-2a1993d0-709c-4521-82ca-2c50bf145ff5 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups/4b2913ed-86b0-4587-843f-c453f93f79f4 HTTP/1.1" status: 404 len: 347 time: 0.0277932 Nov 18 21:09:27.162697 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41680) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:27.349854 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Deleting port 52528f0f-114f-40ae-8853-f40fc888eeb9 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:09:27.350536 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.394824 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65cf73b9-3a10-427a-94bd-c4ca89c00eb2 None None] New status for floating IP 8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84: DOWN {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:09:27.449431 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.449751 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.465526 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Calling delete_port for 52528f0f-114f-40ae-8853-f40fc888eeb9 owned by network:floatingip {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:09:27.572658 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 9f8d85f0-073b-4d3b-b9e3-f904463e7647 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:09:27.639353 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.640210 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 9f8d85f0-073b-4d3b-b9e3-f904463e7647 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:09:27.640552 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 9f8d85f0-073b-4d3b-b9e3-f904463e7647 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:09:27.643916 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.db.api [None req-65cf73b9-3a10-427a-94bd-c4ca89c00eb2 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=102671) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 18 21:09:27.644861 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG oslo_db.api [None req-65cf73b9-3a10-427a-94bd-c4ca89c00eb2 None None] Performing DB retry for function neutron.api.rpc.handlers.l3_rpc.L3RpcCallback.update_floatingip_statuses {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 18 21:09:27.671104 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event deleted for resources: {'Port': ['ID=52528f0f-114f-40ae-8853-f40fc888eeb9,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:27.737298 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.740247 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:27.745395 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-3896a302-5f84-418d-9ee3-19b6650e04cf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "DELETE /v2.0/floatingips/8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84 HTTP/1.1" status: 204 len: 168 time: 0.5777123 Nov 18 21:09:28.146595 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-65cf73b9-3a10-427a-94bd-c4ca89c00eb2 None None] New status for floating IP 8456ddf0-3cd9-4ce3-a26d-67c9ea9b9e84: DOWN {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:09:28.338442 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41694) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:28.343097 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1534389382', 'description': 'tempest-description--1991719109'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:28.366798 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.444770 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.450527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.483435 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.487283 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.1452632 Nov 18 21:09:28.487624 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41706) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:28.493155 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'security_group_rule': {'security_group_id': '5a6d04a6-1d94-4022-ab15-72ac89f4a7e3', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:28.495555 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-409bcf5b-931b-4919-a8db-2433b02171c6 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'SecurityGroup': ['ID=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:28.525741 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.581907 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.586859 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.605222 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f5938ed7-0f4a-4dd2-9381-677ebaa010f3,revision_number=0']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:28.620213 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.621517 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-6c2326f0-8301-405a-9135-2658da4ac837 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.1328490 Nov 18 21:09:28.624430 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41712) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:28.629417 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'security_group_rule': {'security_group_id': '5a6d04a6-1d94-4022-ab15-72ac89f4a7e3', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:28.658020 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.734732 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.737846 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-863938'] for security_group_rule, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.759896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=3f05107d-ce0e-41ab-a22b-f67607166578,revision_number=0']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:28.766927 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group_rule, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.768532 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-dab9d3ed-cd70-432c-a587-3c57d8f8e11f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.1428068 Nov 18 21:09:28.771705 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41718) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:28.777142 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:28.808494 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:28.909300 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.019682 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Allocated IP 172.27.3.220 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/5f1da3ab-5273-4b8a-b58d-4c59e6adb5d2) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:29.130578 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.168720 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.213775 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:29.216815 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:29.220462 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:29.225980 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'Port': ['ID=5f1da3ab-5273-4b8a-b58d-4c59e6adb5d2,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:29.313000 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.347495 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.506038 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.510708 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.583118 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'Port': ['ID=5f1da3ab-5273-4b8a-b58d-4c59e6adb5d2,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:29.598134 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.613328 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:29.614556 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a0bd6c2f-40e4-4830-abf4-473153053f90 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 0.8414681 Nov 18 21:09:29.801308 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:09:29.852813 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-e9ee5fa8-2a16-44a4-af09-155135308d39 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-securitygroup--1534389382&fields=id&tenant_id=c3bcf8e1cce94073aab8b79c5acafab3 HTTP/1.1" status: 200 len: 267 time: 0.0703278 Nov 18 21:09:29.979449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-65632e83-3fc3-4d14-ab39-cbc032bbfb23 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:29.980827 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-65632e83-3fc3-4d14-ab39-cbc032bbfb23 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 810 time: 0.1237783 Nov 18 21:09:29.996457 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-16d8c6d8-c021-4b08-9c5e-4b73b557f0fe tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/quotas/c3bcf8e1cce94073aab8b79c5acafab3 HTTP/1.1" status: 200 len: 375 time: 0.0098891 Nov 18 21:09:30.049534 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-5966691b-db1f-49a8-af07-ad7d236172a4 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0471640 Nov 18 21:09:30.100768 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41746) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:30.157302 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-e4a911bd-cb9d-4889-ba39-9874532fdce3 service neutron] 10.222.0.61 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0918350 Nov 18 21:09:30.221346 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c5afb80f-8dc0-4fbd-9258-5aeba2b67780 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.256023 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-1b0975da-3d41-4301-9774-aadd2a7ae102 service neutron] 10.222.0.61 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0918989 Nov 18 21:09:30.325388 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c5afb80f-8dc0-4fbd-9258-5aeba2b67780 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.330190 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c5afb80f-8dc0-4fbd-9258-5aeba2b67780 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.372996 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5afb80f-8dc0-4fbd-9258-5aeba2b67780 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0ce1d7c3-aed8-49e5-ab91-79c0c1f61dc4,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:30.381888 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41752) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:30.384453 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c5afb80f-8dc0-4fbd-9258-5aeba2b67780 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d0a07124307545e89bfa5ad38074414d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2808516 Nov 18 21:09:30.441393 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d555c700-b93a-47ea-8ecb-784bd7d78f7c req-eea5cb2b-1688-449b-8b6d-734352c3c727 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 210 time: 0.0330324 Nov 18 21:09:30.451280 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2bacc41e-ad8a-42cd-8f4f-5af8efe776b6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.481788 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2bacc41e-ad8a-42cd-8f4f-5af8efe776b6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.532717 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2bacc41e-ad8a-42cd-8f4f-5af8efe776b6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.535391 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-2bacc41e-ad8a-42cd-8f4f-5af8efe776b6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.536719 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-2bacc41e-ad8a-42cd-8f4f-5af8efe776b6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/0ce1d7c3-aed8-49e5-ab91-79c0c1f61dc4 HTTP/1.1" status: 204 len: 168 time: 0.1526713 Nov 18 21:09:30.551668 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bacc41e-ad8a-42cd-8f4f-5af8efe776b6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0ce1d7c3-aed8-49e5-ab91-79c0c1f61dc4,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:30.877191 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41768) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:30.892412 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8033de7-e06a-46f4-bbba-6b9d3fe2562a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.978289 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8033de7-e06a-46f4-bbba-6b9d3fe2562a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:30.986568 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8033de7-e06a-46f4-bbba-6b9d3fe2562a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:31.033214 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a8033de7-e06a-46f4-bbba-6b9d3fe2562a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=82eff5dc337746549575d8ec5460dc00&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1549635 Nov 18 21:09:31.033990 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8033de7-e06a-46f4-bbba-6b9d3fe2562a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8621c387-16df-4b4f-932f-aacf4b34f88a,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:31.036078 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41770) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:31.093476 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2e2169ac-3ecb-418a-ada5-a61a4736704d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:31.118446 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2e2169ac-3ecb-418a-ada5-a61a4736704d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:31.185855 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2e2169ac-3ecb-418a-ada5-a61a4736704d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:31.188955 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-2e2169ac-3ecb-418a-ada5-a61a4736704d admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:31.190567 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-2e2169ac-3ecb-418a-ada5-a61a4736704d admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/8621c387-16df-4b4f-932f-aacf4b34f88a HTTP/1.1" status: 204 len: 168 time: 0.1532702 Nov 18 21:09:31.203488 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e2169ac-3ecb-418a-ada5-a61a4736704d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8621c387-16df-4b4f-932f-aacf4b34f88a,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:31.562580 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dc0722d7-6737-4439-8842-419eab5829a5 req-1a6b1de6-9176-49a9-b553-17c6129ea070 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 210 time: 0.0334313 Nov 18 21:09:31.596945 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-4d2e585b-b38c-4112-a4dc-5744eb78e350 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:31.599023 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-4d2e585b-b38c-4112-a4dc-5744eb78e350 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 810 time: 0.1796694 Nov 18 21:09:31.683410 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-7a70fc7c-5edc-4789-aeff-f55b08a91b61 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=c3bcf8e1cce94073aab8b79c5acafab3 HTTP/1.1" status: 200 len: 380 time: 0.0631804 Nov 18 21:09:31.702559 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'port': {'device_id': '8881078e-5419-4934-91a6-012b5d902c21', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'admin_state_up': True, 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'security_groups': ['5a6d04a6-1d94-4022-ab15-72ac89f4a7e3']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:31.843683 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Made reservation on behalf of c3bcf8e1cce94073aab8b79c5acafab3 for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:09:31.848838 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.003697 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Allocated IP 172.20.0.7 (b99d0e78-8d9d-4599-8cb9-01e271840ab6/fff76f80-c70a-413a-aadb-600c993bbf6b/1868920b-7e7f-4f3c-8425-37348e29ece7) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:32.156813 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.197114 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.201441 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-026a177e-5161-4cfc-94d1-3d25c4c7ae2b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.244385 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:32.247438 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:32.251165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:32.287423 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event updated for resources: {'Port': ['ID=1868920b-7e7f-4f3c-8425-37348e29ece7,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:32.324264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:32.324937 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.342652 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-f69e388d-e522-4ede-9505-cdddfbca5ec2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.6443238 Nov 18 21:09:32.357102 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Request body: {'port': {'device_id': '8881078e-5419-4934-91a6-012b5d902c21', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:32.419566 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.555505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-1c382fc5-098b-44aa-9b15-4aaccb6cec21 None None] Provisioning complete for port 1868920b-7e7f-4f3c-8425-37348e29ece7 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:32.556529 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1c382fc5-098b-44aa-9b15-4aaccb6cec21 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.603178 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-1c382fc5-098b-44aa-9b15-4aaccb6cec21 None None] Port 1868920b-7e7f-4f3c-8425-37348e29ece7 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:32.712471 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4cb8595-0599-4dc8-8f98-e7a52740d6f7 req-5b36812d-b338-41e4-a60e-1166b197c9db tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:32.715475 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b4cb8595-0599-4dc8-8f98-e7a52740d6f7 req-5b36812d-b338-41e4-a60e-1166b197c9db tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 931 time: 0.0565038 Nov 18 21:09:32.733618 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 1868920b-7e7f-4f3c-8425-37348e29ece7 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:09:32.743167 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.757449 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Transition to ACTIVE for port object 1868920b-7e7f-4f3c-8425-37348e29ece7 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:09:32.762792 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:32.786842 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-b4cb8595-0599-4dc8-8f98-e7a52740d6f7 req-03ea03a3-1bdb-48fa-871f-bc1022a2cfbe tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0633523 Nov 18 21:09:32.848740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Pushing event updated for resources: {'Port': ['ID=1868920b-7e7f-4f3c-8425-37348e29ece7,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:32.905867 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Attempting to bind port 1868920b-7e7f-4f3c-8425-37348e29ece7 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:32.906293 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Attempting to bind port 1868920b-7e7f-4f3c-8425-37348e29ece7 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:32.906695 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Attempting to bind port 1868920b-7e7f-4f3c-8425-37348e29ece7 on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:32.911913 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Port 1868920b-7e7f-4f3c-8425-37348e29ece7 on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:09:32.912348 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Attempting to bind port 1868920b-7e7f-4f3c-8425-37348e29ece7 on network b99d0e78-8d9d-4599-8cb9-01e271840ab6 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:32.918292 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:32.918761 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Checking segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:32.919207 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Bound using segment: {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:32.919721 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Bound port: 1868920b-7e7f-4f3c-8425-37348e29ece7, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'efaeced5-9640-4392-842a-6c363cdec428', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 635, 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:32.920392 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:33.003409 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] For port 1868920b-7e7f-4f3c-8425-37348e29ece7, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:33.008538 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] For port 1868920b-7e7f-4f3c-8425-37348e29ece7, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1868920b-7e7f-4f3c-8425-37348e29ece7,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:33.020967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:33.070226 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.071226 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:33.072960 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] 10.222.0.62 "PUT /v2.0/ports/1868920b-7e7f-4f3c-8425-37348e29ece7 HTTP/1.1" status: 200 len: 1093 time: 0.7215409 Nov 18 21:09:33.073526 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:09:33.077219 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a3d2218f-d742-45ad-8646-4d2d843adb9c" -d '{"events": [{"name": "network-changed", "server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:09:33.107939 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789ca070-3a26-4f39-80d6-b1af80e2a2c1 service neutron] Pushing event updated for resources: {'Port': ['ID=1868920b-7e7f-4f3c-8425-37348e29ece7,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:33.174748 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:09:33 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6cc4a2f2-4ecb-4dbc-806f-a73270f73aca x-openstack-request-id: req-6cc4a2f2-4ecb-4dbc-806f-a73270f73aca {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:09:33.175041 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:09:33.175554 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-6cc4a2f2-4ecb-4dbc-806f-a73270f73aca {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:09:33.176004 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'status': 'completed', 'code': 200} Nov 18 21:09:33.206320 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-14953ba6-f578-4e06-b0a4-af2d827cff2d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.208136 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-14953ba6-f578-4e06-b0a4-af2d827cff2d service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 1096 time: 0.0757201 Nov 18 21:09:33.263039 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-cbe8112f-c4c1-411c-8612-279d54ab79eb service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1868920b-7e7f-4f3c-8425-37348e29ece7 HTTP/1.1" status: 200 len: 217 time: 0.0448408 Nov 18 21:09:33.322482 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-d751ec1f-9890-4f3c-b1c8-3a1ba7ff2004 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.323932 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-d751ec1f-9890-4f3c-b1c8-3a1ba7ff2004 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0520015 Nov 18 21:09:33.385673 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-b88524f0-dfa1-4f45-ae9c-a3901d1b2d3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.387572 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-b88524f0-dfa1-4f45-ae9c-a3901d1b2d3a service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0559745 Nov 18 21:09:33.488096 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-93e74050-14fc-41fb-9ba7-87ceedc707a3 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0926046 Nov 18 21:09:33.596635 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0afb6438-f0c6-4e7f-8c94-d8164c2d8a0e req-56a85ba8-a157-450a-9556-842d912dcc79 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0973322 Nov 18 21:09:33.700242 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-0906240d-42ff-4147-9f27-a46b4cf95719 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.702126 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-0906240d-42ff-4147-9f27-a46b4cf95719 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 1096 time: 0.0464101 Nov 18 21:09:33.831824 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-3c2906cd-003b-47aa-9e8b-79f31aaddf06 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.833393 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-3c2906cd-003b-47aa-9e8b-79f31aaddf06 service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.1239491 Nov 18 21:09:33.897381 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-ec047519-2ea6-4715-98f6-0a621bbf284b service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1868920b-7e7f-4f3c-8425-37348e29ece7 HTTP/1.1" status: 200 len: 217 time: 0.0449085 Nov 18 21:09:33.936258 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3682d1f1-c84b-45a0-827f-9098740ee9f0 req-7e56a487-292d-4455-bda6-3516cbc79373 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.939894 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3682d1f1-c84b-45a0-827f-9098740ee9f0 req-7e56a487-292d-4455-bda6-3516cbc79373 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 943 time: 0.0632319 Nov 18 21:09:33.965139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-34a1df25-8af4-483e-982b-625fb701fc21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:33.966726 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-34a1df25-8af4-483e-982b-625fb701fc21 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0672200 Nov 18 21:09:34.006160 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-3682d1f1-c84b-45a0-827f-9098740ee9f0 req-06b6ee84-941e-4e11-bfe1-6df83c06a304 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607107 Nov 18 21:09:34.039058 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-288e0645-4ffb-44d0-bd14-4d9e95ec9959 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:34.041722 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-288e0645-4ffb-44d0-bd14-4d9e95ec9959 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0581717 Nov 18 21:09:34.156839 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-984dfe90-20e3-48a7-923e-b5d775409b66 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1073155 Nov 18 21:09:34.190465 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41856) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:34.265253 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a3d2218f-d742-45ad-8646-4d2d843adb9c req-7970f8e6-1696-4ad6-926d-b98fa99a6cd8 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0988810 Nov 18 21:09:34.332907 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7edb4407-32ba-47ab-8676-0fb16c79a435 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.432574 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7edb4407-32ba-47ab-8676-0fb16c79a435 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.436915 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7edb4407-32ba-47ab-8676-0fb16c79a435 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.480945 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7edb4407-32ba-47ab-8676-0fb16c79a435 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=05247855972a466aa2bf6efb93564adf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2883289 Nov 18 21:09:34.481777 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7edb4407-32ba-47ab-8676-0fb16c79a435 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1cee25ca-55ec-4759-af3d-ee27665c4ac9,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:34.484040 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41860) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:34.540775 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7d32e7d8-9a11-463e-a4a1-ba35cd066bca admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.561769 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7d32e7d8-9a11-463e-a4a1-ba35cd066bca admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.614783 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7d32e7d8-9a11-463e-a4a1-ba35cd066bca admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.617817 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7d32e7d8-9a11-463e-a4a1-ba35cd066bca admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.619166 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7d32e7d8-9a11-463e-a4a1-ba35cd066bca admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1cee25ca-55ec-4759-af3d-ee27665c4ac9 HTTP/1.1" status: 204 len: 168 time: 0.1341755 Nov 18 21:09:34.627686 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d32e7d8-9a11-463e-a4a1-ba35cd066bca admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1cee25ca-55ec-4759-af3d-ee27665c4ac9,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:34.634450 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9b423f76-5c2e-4d2c-835e-75ad7f06c663 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.892174 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41866) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:34.906706 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5024fe6a-91ce-4a74-9412-42dc12ad850a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.984935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5024fe6a-91ce-4a74-9412-42dc12ad850a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:34.988986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-5024fe6a-91ce-4a74-9412-42dc12ad850a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.028688 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-5024fe6a-91ce-4a74-9412-42dc12ad850a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e1321f25d9df42ffb1f7e84cadecc855&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1353681 Nov 18 21:09:35.029699 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5024fe6a-91ce-4a74-9412-42dc12ad850a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f6957c9-7cc9-46a9-ba97-9f910e2879ce,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:35.031314 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41868) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:35.091672 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7c5a440a-463b-4fea-a22b-face05d393e3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.116011 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7c5a440a-463b-4fea-a22b-face05d393e3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.146281 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80488462-8f9c-4603-aefe-92ffe988c8c9 req-29aeda05-ffa0-4326-962c-7620bf0f357f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:35.154123 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80488462-8f9c-4603-aefe-92ffe988c8c9 req-29aeda05-ffa0-4326-962c-7620bf0f357f tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 943 time: 0.0588789 Nov 18 21:09:35.173917 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7c5a440a-463b-4fea-a22b-face05d393e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.177116 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7c5a440a-463b-4fea-a22b-face05d393e3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.186405 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7c5a440a-463b-4fea-a22b-face05d393e3 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3f6957c9-7cc9-46a9-ba97-9f910e2879ce HTTP/1.1" status: 204 len: 168 time: 0.1532383 Nov 18 21:09:35.195025 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c5a440a-463b-4fea-a22b-face05d393e3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f6957c9-7cc9-46a9-ba97-9f910e2879ce,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:35.208145 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-80488462-8f9c-4603-aefe-92ffe988c8c9 req-27460aa0-db25-489e-a3c0-61d8508bac99 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531197 Nov 18 21:09:35.526803 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1868920b-7e7f-4f3c-8425-37348e29ece7 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:09:35.638522 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 1868920b-7e7f-4f3c-8425-37348e29ece7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1868920b-7e7f-4f3c-8425-37348e29ece7,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:35.651797 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'port_id': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'mac_address': 'fa:16:3e:a6:3b:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 635, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:09:35.693589 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.711222 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 1868920b-7e7f-4f3c-8425-37348e29ece7 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:09:35.733240 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 1868920b-7e7f-4f3c-8425-37348e29ece7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1868920b-7e7f-4f3c-8425-37348e29ece7,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:35.745421 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:35.807438 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=1868920b-7e7f-4f3c-8425-37348e29ece7,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:36.008542 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['1868920b-7e7f-4f3c-8425-37348e29ece7'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:09:36.046859 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:36.350295 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c636428-d2ba-4598-930b-fd6b7aed4be8 req-71e93e54-b8ee-45f6-9f70-1c0749b6a4b7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:36.351030 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8c636428-d2ba-4598-930b-fd6b7aed4be8 req-71e93e54-b8ee-45f6-9f70-1c0749b6a4b7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 944 time: 0.0585027 Nov 18 21:09:36.404277 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-8c636428-d2ba-4598-930b-fd6b7aed4be8 req-a44d773a-3cc6-4858-9cb8-5530a85d4c49 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465107 Nov 18 21:09:37.405330 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41954) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:37.490457 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.533397 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdb33e31-0f27-41b3-8dc1-cc3a5c5695d4 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.558038 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1868920b-7e7f-4f3c-8425-37348e29ece7 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:09:37.567648 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab3fa7fb-b117-4686-9831-6673dcf3fa73 req-eae93a25-aeff-4cad-96a6-c346d01266a7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:37.569221 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ab3fa7fb-b117-4686-9831-6673dcf3fa73 req-eae93a25-aeff-4cad-96a6-c346d01266a7 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 944 time: 0.0924721 Nov 18 21:09:37.615299 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 1868920b-7e7f-4f3c-8425-37348e29ece7 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:09:37.620386 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 1868920b-7e7f-4f3c-8425-37348e29ece7 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:37.620764 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.645442 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-ab3fa7fb-b117-4686-9831-6673dcf3fa73 req-2da18884-f88f-46c1-8892-ef49cfe51468 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0680456 Nov 18 21:09:37.686322 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdb33e31-0f27-41b3-8dc1-cc3a5c5695d4 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.691179 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-cdb33e31-0f27-41b3-8dc1-cc3a5c5695d4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.705868 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.732349 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:09:37.734695 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6f98a270-c605-4307-8c64-84a7ff9b9682" -d '{"events": [{"server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "name": "network-vif-plugged", "status": "completed", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:09:37.736161 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-cdb33e31-0f27-41b3-8dc1-cc3a5c5695d4 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=7e6aaa4d9c4c4d768a3f29b78c60fd39&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3296399 Nov 18 21:09:37.737051 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdb33e31-0f27-41b3-8dc1-cc3a5c5695d4 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9f6459c4-23a2-4194-9524-ec151e0426d7,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:37.739090 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41966) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:37.764152 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 1868920b-7e7f-4f3c-8425-37348e29ece7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1868920b-7e7f-4f3c-8425-37348e29ece7,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:37.769181 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.797112 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:09:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-083f3066-58a0-4f83-90b9-635a69b4296a x-openstack-request-id: req-083f3066-58a0-4f83-90b9-635a69b4296a {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:09:37.797338 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "name": "network-vif-plugged", "status": "completed", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:09:37.797561 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-083f3066-58a0-4f83-90b9-635a69b4296a {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:09:37.797950 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'code': 200} Nov 18 21:09:37.809767 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c9297024-b264-47b5-b74f-6001f5f56e3a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.839972 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=1868920b-7e7f-4f3c-8425-37348e29ece7,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:37.843789 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c9297024-b264-47b5-b74f-6001f5f56e3a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.897018 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c9297024-b264-47b5-b74f-6001f5f56e3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.900408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c9297024-b264-47b5-b74f-6001f5f56e3a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:37.902080 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c9297024-b264-47b5-b74f-6001f5f56e3a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/9f6459c4-23a2-4194-9524-ec151e0426d7 HTTP/1.1" status: 204 len: 168 time: 0.1612594 Nov 18 21:09:37.910425 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9297024-b264-47b5-b74f-6001f5f56e3a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9f6459c4-23a2-4194-9524-ec151e0426d7,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:37.984943 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-09e255c2-b44c-4318-af11-21148106375d req-9ef561a0-082d-489b-90b0-8dffc04ef2f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:37.986466 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-09e255c2-b44c-4318-af11-21148106375d req-9ef561a0-082d-489b-90b0-8dffc04ef2f9 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 1098 time: 0.0485470 Nov 18 21:09:38.038704 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-09e255c2-b44c-4318-af11-21148106375d req-db84ef31-7c29-4981-b598-e98a751fc292 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0445018 Nov 18 21:09:38.216072 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 41972) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:38.233470 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-be780f84-1dcb-4eab-a2db-7f2908203bad admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.249575 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.329682 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-be780f84-1dcb-4eab-a2db-7f2908203bad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.334218 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-be780f84-1dcb-4eab-a2db-7f2908203bad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.393456 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-be780f84-1dcb-4eab-a2db-7f2908203bad admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=698a91c2b13140c0af91f3ad6aedcc71&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1761882 Nov 18 21:09:38.394211 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-be780f84-1dcb-4eab-a2db-7f2908203bad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f09b922e-bacf-44ae-80ab-e962e83ac063,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:38.396507 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 41976) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:38.457804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8531f2f-9c81-469f-86e3-b148f9001de3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.484022 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8531f2f-9c81-469f-86e3-b148f9001de3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.549408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8531f2f-9c81-469f-86e3-b148f9001de3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.552180 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a8531f2f-9c81-469f-86e3-b148f9001de3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:38.553767 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a8531f2f-9c81-469f-86e3-b148f9001de3 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f09b922e-bacf-44ae-80ab-e962e83ac063 HTTP/1.1" status: 204 len: 168 time: 0.1556215 Nov 18 21:09:38.563567 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8531f2f-9c81-469f-86e3-b148f9001de3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f09b922e-bacf-44ae-80ab-e962e83ac063,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:38.793337 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a527d46-bb21-4a26-bab9-7ec14b8e1e91 req-aa6d65e9-6b45-455f-83b3-30aadc199afc tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:38.794808 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8a527d46-bb21-4a26-bab9-7ec14b8e1e91 req-aa6d65e9-6b45-455f-83b3-30aadc199afc tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.0642600 Nov 18 21:09:38.871005 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8a527d46-bb21-4a26-bab9-7ec14b8e1e91 req-2eca73d5-1420-46bc-acd6-11b071c7c012 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0639498 Nov 18 21:09:39.934085 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42012) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:40.004023 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69491d58-7690-41eb-8559-738d8088e57e req-f2df3455-9607-420d-a852-f85d9daf10c2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:40.005724 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-69491d58-7690-41eb-8559-738d8088e57e req-f2df3455-9607-420d-a852-f85d9daf10c2 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.0525434 Nov 18 21:09:40.058275 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9aae6ab2-7dee-4e1e-bd38-b474eac0cb35 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.059549 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-69491d58-7690-41eb-8559-738d8088e57e req-b555bdf0-5fbb-42e6-abe1-2771b9689d2c tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465212 Nov 18 21:09:40.157160 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9aae6ab2-7dee-4e1e-bd38-b474eac0cb35 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.171540 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9aae6ab2-7dee-4e1e-bd38-b474eac0cb35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.218137 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9aae6ab2-7dee-4e1e-bd38-b474eac0cb35 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c61240280df64fa4b9578b63e83050ed&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2826447 Nov 18 21:09:40.218830 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9aae6ab2-7dee-4e1e-bd38-b474eac0cb35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dd975652-9724-490e-8e87-6219610507c2,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:40.222223 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 42018) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:40.233249 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f7bcbbca-f73d-4187-ad7c-3d6d6e60d881 req-c309d5d6-6e25-49c9-99d4-9062c121c324 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:40.234750 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-f7bcbbca-f73d-4187-ad7c-3d6d6e60d881 req-c309d5d6-6e25-49c9-99d4-9062c121c324 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.0957007 Nov 18 21:09:40.244671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42020) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:09:40.249138 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Request body: {'floatingip': {'port_id': '1868920b-7e7f-4f3c-8425-37348e29ece7'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:40.289408 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fae37218-a9e0-4abd-84e2-e8ed34363fd6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.295497 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.321231 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fae37218-a9e0-4abd-84e2-e8ed34363fd6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.392810 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fae37218-a9e0-4abd-84e2-e8ed34363fd6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.397720 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-fae37218-a9e0-4abd-84e2-e8ed34363fd6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:40.400496 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-fae37218-a9e0-4abd-84e2-e8ed34363fd6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/dd975652-9724-490e-8e87-6219610507c2 HTTP/1.1" status: 204 len: 168 time: 0.1755846 Nov 18 21:09:40.413948 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fae37218-a9e0-4abd-84e2-e8ed34363fd6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd975652-9724-490e-8e87-6219610507c2,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:41.073306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:41.077618 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:41.188631 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Floating IP 427dba68-c9a5-4d11-aeb3-c86d0965e8ce associated. External IP: 172.27.3.220, port: 1868920b-7e7f-4f3c-8425-37348e29ece7. Nov 18 21:09:41.409556 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:09:41.539234 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:09:41.546728 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:41.549140 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:09:41.559994 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:41.560724 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:41.584782 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-553b5714-a595-408a-a877-07484d22d8a9 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "PUT /v2.0/floatingips/427dba68-c9a5-4d11-aeb3-c86d0965e8ce HTTP/1.1" status: 200 len: 991 time: 1.3363621 Nov 18 21:09:41.584782 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:09:41.585056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-48714cfc-f1ff-4a97-84b2-683b816a6176" -d '{"events": [{"name": "network-changed", "server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:09:41.625219 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:09:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3c53b3e4-2a7e-4ad3-b050-cb07e2064ddb x-openstack-request-id: req-3c53b3e4-2a7e-4ad3-b050-cb07e2064ddb {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:09:41.625518 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:09:41.625776 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-3c53b3e4-2a7e-4ad3-b050-cb07e2064ddb {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:09:41.626186 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'status': 'completed', 'code': 200} Nov 18 21:09:41.718408 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:41.719489 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-001a2bf5-8d0c-451a-9282-c2889125f6c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:41.721332 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-001a2bf5-8d0c-451a-9282-c2889125f6c2 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 1098 time: 0.0672486 Nov 18 21:09:41.840866 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-980ff2a4-3a2d-47fc-af7a-bcb294ebab5c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:41.842350 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-980ff2a4-3a2d-47fc-af7a-bcb294ebab5c service neutron] 10.222.0.62 "GET /v2.0/networks?id=b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 200 len: 911 time: 0.1068194 Nov 18 21:09:41.924271 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-32260349-1d62-476a-ad02-df086e6b66b1 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=1868920b-7e7f-4f3c-8425-37348e29ece7 HTTP/1.1" status: 200 len: 999 time: 0.0721273 Nov 18 21:09:41.983954 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-a912e9f2-004d-4cd9-ad71-e1c412d71c3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:41.985393 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-a912e9f2-004d-4cd9-ad71-e1c412d71c3c service neutron] 10.222.0.62 "GET /v2.0/subnets?id=fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 200 len: 849 time: 0.0533016 Nov 18 21:09:42.013508 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '427dba68-c9a5-4d11-aeb3-c86d0965e8ce', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'floating_ip_address': '172.27.3.220', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'port_id': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 587, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'mac_address': 'fa:16:3e:a6:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8881078e-5419-4934-91a6-012b5d902c21', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:09:29Z', 'updated_at': '2021-11-18T21:09:40Z', 'revision_number': 1, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:42.035740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-d12876d0-cf54-48e3-8a41-dcba0381a327 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:42.037285 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-d12876d0-cf54-48e3-8a41-dcba0381a327 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=b99d0e78-8d9d-4599-8cb9-01e271840ab6&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0442064 Nov 18 21:09:42.051880 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:09:42.062712 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:09:42.063391 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:09:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:42.163845 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-5905ad0a-e763-4dac-9fe3-55e7cb1ad84c service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1156135 Nov 18 21:09:42.202583 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:09:42.290354 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-48714cfc-f1ff-4a97-84b2-683b816a6176 req-c798e20b-c37a-4c95-a719-4e4861b22007 service neutron] 10.222.0.62 "GET /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1174750 Nov 18 21:09:42.450746 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '427dba68-c9a5-4d11-aeb3-c86d0965e8ce', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'floating_ip_address': '172.27.3.220', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'port_id': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 587, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'mac_address': 'fa:16:3e:a6:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8881078e-5419-4934-91a6-012b5d902c21', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:09:29Z', 'updated_at': '2021-11-18T21:09:40Z', 'revision_number': 1, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:09:42.482410 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-cb0ab48c-aaf5-4269-8aa3-39c86d2ed0d8 None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '427dba68-c9a5-4d11-aeb3-c86d0965e8ce', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'floating_ip_address': '172.27.3.220', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'port_id': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 587, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'mac_address': 'fa:16:3e:a6:3b:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8881078e-5419-4934-91a6-012b5d902c21', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:09:29Z', 'updated_at': '2021-11-18T21:09:40Z', 'revision_number': 1, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:09:42.684586 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-57632bae-36e6-4390-91c4-76a1a262c730 None None] New status for floating IP 427dba68-c9a5-4d11-aeb3-c86d0965e8ce: ACTIVE {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:09:42.911832 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-dd437c40-e27c-439a-a12a-af82c23a77a2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1633191489&fields=id&tenant_id=97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 267 time: 0.0687773 Nov 18 21:09:43.022468 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-0888b2f7-47db-43aa-aef3-c51989ffdc52 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:43.023913 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-0888b2f7-47db-43aa-aef3-c51989ffdc52 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 812 time: 0.1046767 Nov 18 21:09:43.038522 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-208c6e81-2d10-4c6f-b3ce-d52c8fcbbfd5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/quotas/97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 375 time: 0.0087814 Nov 18 21:09:43.089478 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-8b9e11a7-683a-4013-a753-f7cf8d5c077d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0455949 Nov 18 21:09:43.197591 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f65b821c-c960-4389-a546-62022d808f0c service neutron] 10.222.0.61 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0956018 Nov 18 21:09:43.294462 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-837ef4a3-f718-474d-98b4-56ec571645c9 service neutron] 10.222.0.61 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0907216 Nov 18 21:09:43.593872 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-8d76292c-fef0-45be-966c-d9e5bfe7e70f req-902e82d3-0bb0-43e7-b659-95199b90c06e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 210 time: 0.0287580 Nov 18 21:09:44.694056 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-776b5b13-82dc-4acd-b7b3-fecff04872b6 req-f9dbfd72-0b7c-4a60-8669-85598d704c2d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 210 time: 0.0267622 Nov 18 21:09:45.792039 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-30b04e64-f70f-4470-b1c8-4ca31836525a req-67c3ee16-4666-4aa8-9940-8abf70fab0de tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 210 time: 0.0283301 Nov 18 21:09:46.495737 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-4ae02383-afba-49b4-9417-f844aee30076 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:46.497265 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-4ae02383-afba-49b4-9417-f844aee30076 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 812 time: 0.1117454 Nov 18 21:09:46.594552 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-305ab6e7-5450-4d70-a498-940baef784cf tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 380 time: 0.0857723 Nov 18 21:09:46.606526 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'port': {'device_id': '69be415b-5392-4831-ade3-a25149fe0e91', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'admin_state_up': True, 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'security_groups': ['05581fc3-f5ff-492a-8f7f-0d168cec3421']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:46.725149 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Made reservation on behalf of 97c605960c964eb3960a3f3324bf46bb for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:09:46.729480 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:46.864041 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Allocated IP 172.20.0.12 (e9895462-5764-4a81-a2a3-f5482f05a6a3/a8ffc170-cfa2-4b16-935a-923d6b39dd63/70619f48-20be-43ef-83b4-c6cd99978c38) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:09:46.950729 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-b9993db9-8a82-40e0-bf2b-3e93e6c88fca req-1b6c2f46-28fc-4c49-a077-21aeef1ad3b7 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 210 time: 0.0693593 Nov 18 21:09:47.099196 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.145938 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.189276 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:09:47.192587 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:09:47.199527 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:09:47.246031 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=70619f48-20be-43ef-83b4-c6cd99978c38,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:47.261118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:47.261784 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.285696 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-5f0e20f9-810b-4af7-8cac-53bed0c5125e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.6827121 Nov 18 21:09:47.306810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Request body: {'port': {'device_id': '69be415b-5392-4831-ade3-a25149fe0e91', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:09:47.367403 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.407646 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-1ef593e6-02cc-47fb-b144-a0b43e60f6d6 None None] Provisioning complete for port 70619f48-20be-43ef-83b4-c6cd99978c38 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:09:47.408340 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-1ef593e6-02cc-47fb-b144-a0b43e60f6d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.442866 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-1ef593e6-02cc-47fb-b144-a0b43e60f6d6 None None] Port 70619f48-20be-43ef-83b4-c6cd99978c38 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:09:47.646447 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 70619f48-20be-43ef-83b4-c6cd99978c38 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:09:47.655368 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.669128 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Transition to ACTIVE for port object 70619f48-20be-43ef-83b4-c6cd99978c38 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:09:47.672526 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.725564 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Pushing event updated for resources: {'Port': ['ID=70619f48-20be-43ef-83b4-c6cd99978c38,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:47.802309 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Attempting to bind port 70619f48-20be-43ef-83b4-c6cd99978c38 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:09:47.802944 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Attempting to bind port 70619f48-20be-43ef-83b4-c6cd99978c38 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:09:47.803458 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Attempting to bind port 70619f48-20be-43ef-83b4-c6cd99978c38 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:47.809856 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Port 70619f48-20be-43ef-83b4-c6cd99978c38 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:09:47.810184 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Attempting to bind port 70619f48-20be-43ef-83b4-c6cd99978c38 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:09:47.815707 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 9, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:09:47.815955 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Checking segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:09:47.816445 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Bound using segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:09:47.817139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Bound port: 70619f48-20be-43ef-83b4-c6cd99978c38, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:09:47.817494 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.891258 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] For port 70619f48-20be-43ef-83b4-c6cd99978c38, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:09:47.894429 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] For port 70619f48-20be-43ef-83b4-c6cd99978c38, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=70619f48-20be-43ef-83b4-c6cd99978c38,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:09:47.900638 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.938817 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:47.938817 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:47.940944 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] 10.222.0.62 "PUT /v2.0/ports/70619f48-20be-43ef-83b4-c6cd99978c38 HTTP/1.1" status: 200 len: 1094 time: 0.6386282 Nov 18 21:09:47.940944 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:09:47.942390 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3ba4fa26-708e-408e-8870-eaf914d036ec" -d '{"events": [{"name": "network-changed", "server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:09:47.965683 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8049216-f1b5-472c-a636-e323a3b42fdb service neutron] Pushing event updated for resources: {'Port': ['ID=70619f48-20be-43ef-83b4-c6cd99978c38,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:09:47.997373 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:09:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b52166bb-e1dd-4501-8b7e-427bb5350c68 x-openstack-request-id: req-b52166bb-e1dd-4501-8b7e-427bb5350c68 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:09:47.998211 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:09:47.998551 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-b52166bb-e1dd-4501-8b7e-427bb5350c68 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:09:47.999042 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38', 'status': 'completed', 'code': 200} Nov 18 21:09:48.098840 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df8a53d-37f0-439e-940f-a83e75d409a9 req-27557d5d-07e4-4621-a9ae-dd0be82bbe93 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:48.100471 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9df8a53d-37f0-439e-940f-a83e75d409a9 req-27557d5d-07e4-4621-a9ae-dd0be82bbe93 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0524266 Nov 18 21:09:48.174344 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9df8a53d-37f0-439e-940f-a83e75d409a9 req-743c3090-10ab-4dbf-8f26-62d468d64273 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0670581 Nov 18 21:09:49.298522 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c752029-1fd3-43bc-b82d-93bfdac3495e req-07a880cb-7e3b-45e6-aed7-b39890397b0f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:49.300030 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5c752029-1fd3-43bc-b82d-93bfdac3495e req-07a880cb-7e3b-45e6-aed7-b39890397b0f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0554817 Nov 18 21:09:49.351018 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5c752029-1fd3-43bc-b82d-93bfdac3495e req-9aca8104-1212-41ea-b9b3-68c9f30acb0d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0448742 Nov 18 21:09:49.390678 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:50.232662 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba4fa26-708e-408e-8870-eaf914d036ec req-82392a21-e673-4b3d-92b3-fa712dd0d3ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.234177 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ba4fa26-708e-408e-8870-eaf914d036ec req-82392a21-e673-4b3d-92b3-fa712dd0d3ed service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1097 time: 0.0479860 Nov 18 21:09:50.338712 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba4fa26-708e-408e-8870-eaf914d036ec req-d7f3860b-591b-457b-ae70-072e12860316 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.340230 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ba4fa26-708e-408e-8870-eaf914d036ec req-d7f3860b-591b-457b-ae70-072e12860316 service neutron] 10.222.0.62 "GET /v2.0/networks?tenant_id=97c605960c964eb3960a3f3324bf46bb&shared=False HTTP/1.1" status: 200 len: 913 time: 0.0979731 Nov 18 21:09:50.452928 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ba4fa26-708e-408e-8870-eaf914d036ec req-63dcb2b5-a4cb-4a60-a48b-47825c1ed943 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.454418 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ba4fa26-708e-408e-8870-eaf914d036ec req-63dcb2b5-a4cb-4a60-a48b-47825c1ed943 service neutron] 10.222.0.62 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1070902 Nov 18 21:09:50.496623 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710a2c61-fc9b-4047-9b67-5f8d53934e7e req-11bc0d46-74a1-4267-b569-571d36cb069c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.498167 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-710a2c61-fc9b-4047-9b67-5f8d53934e7e req-11bc0d46-74a1-4267-b569-571d36cb069c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0634816 Nov 18 21:09:50.551470 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-95f4585c-3522-4c83-89bf-dd564fd057b1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.555162 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-95f4585c-3522-4c83-89bf-dd564fd057b1 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1097 time: 0.0489612 Nov 18 21:09:50.559800 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-710a2c61-fc9b-4047-9b67-5f8d53934e7e req-973b6f22-fbdb-4ae0-8560-434168463da6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501034 Nov 18 21:09:50.599785 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-ccb95b8d-541d-402c-9d69-2e211102f901 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=70619f48-20be-43ef-83b4-c6cd99978c38 HTTP/1.1" status: 200 len: 217 time: 0.0373838 Nov 18 21:09:50.654019 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f93b8fb0-9191-461c-a007-76ca198ae91b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.655495 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-f93b8fb0-9191-461c-a007-76ca198ae91b service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0480042 Nov 18 21:09:50.704338 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-71b2171b-22fe-47fd-a91d-99f3b5fd80bd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:50.705838 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-71b2171b-22fe-47fd-a91d-99f3b5fd80bd service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0433455 Nov 18 21:09:50.806951 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-9021e0db-5bef-4f9a-a395-9ea8782af381 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906024 Nov 18 21:09:50.909310 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-83bc734d-9ba1-401f-bf26-c9a4b4883c0d req-e4f8ce6b-562d-41ab-b5df-6c498f122662 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0904603 Nov 18 21:09:51.690682 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39f94e60-6030-4f18-9a65-14afa5a21334 req-aa76baa8-6399-4230-91a3-ac63e9333e26 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:51.692917 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-39f94e60-6030-4f18-9a65-14afa5a21334 req-aa76baa8-6399-4230-91a3-ac63e9333e26 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0557156 Nov 18 21:09:51.748431 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-39f94e60-6030-4f18-9a65-14afa5a21334 req-5fa977e5-d79e-49f9-90b0-be6b80068ea4 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0491102 Nov 18 21:09:52.880977 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-710908c5-b712-46c8-a86f-2244a935939e req-dcadcfb6-0fb5-49e8-94ff-3dbc4891f6d0 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:52.882474 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-710908c5-b712-46c8-a86f-2244a935939e req-dcadcfb6-0fb5-49e8-94ff-3dbc4891f6d0 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0545907 Nov 18 21:09:52.940769 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-710908c5-b712-46c8-a86f-2244a935939e req-ff68a82f-4304-4925-b537-230ecc1c2c20 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513170 Nov 18 21:09:54.063522 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-012e17c9-8fd1-4fb5-8fe4-5cff13a97e6c req-7caee803-58b2-4151-80f6-51eed40b3aec tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:54.065039 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-012e17c9-8fd1-4fb5-8fe4-5cff13a97e6c req-7caee803-58b2-4151-80f6-51eed40b3aec tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0501070 Nov 18 21:09:54.116277 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-012e17c9-8fd1-4fb5-8fe4-5cff13a97e6c req-8dca1368-2853-4c7f-a75d-88b19496fd04 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453405 Nov 18 21:09:55.260276 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5885e20c-5431-4a47-afbf-f730039f9e39 req-23faf6e7-26ca-4e1a-b4a6-1b9f0b5738a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:55.263422 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5885e20c-5431-4a47-afbf-f730039f9e39 req-23faf6e7-26ca-4e1a-b4a6-1b9f0b5738a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0684340 Nov 18 21:09:55.316975 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5885e20c-5431-4a47-afbf-f730039f9e39 req-baa8ef84-805c-4dfa-a98e-554ae58bec62 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466578 Nov 18 21:09:56.441311 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab30572-925e-4577-bec3-70c0dc5579b7 req-3181c9f8-b6f2-4d93-ad16-c77e484aef36 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:56.442853 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1ab30572-925e-4577-bec3-70c0dc5579b7 req-3181c9f8-b6f2-4d93-ad16-c77e484aef36 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0502141 Nov 18 21:09:56.495414 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-1ab30572-925e-4577-bec3-70c0dc5579b7 req-f791d65d-7c52-4776-9a2f-9f42d69edee6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459321 Nov 18 21:09:57.620676 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91b1a5c7-7080-4877-84a3-fcad514eff64 req-d1904f06-2efc-4582-8399-d0457625ace6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:57.622105 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-91b1a5c7-7080-4877-84a3-fcad514eff64 req-d1904f06-2efc-4582-8399-d0457625ace6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0562465 Nov 18 21:09:57.679590 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-91b1a5c7-7080-4877-84a3-fcad514eff64 req-f9fcc3ab-c792-482e-a8f5-7da0ba345a25 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0513856 Nov 18 21:09:58.824096 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e7d5093-175f-4978-8e22-f4747e253d9e req-61f204c8-25ca-485b-a4ce-b39981b20ff2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:09:58.826011 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2e7d5093-175f-4978-8e22-f4747e253d9e req-61f204c8-25ca-485b-a4ce-b39981b20ff2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0686870 Nov 18 21:09:58.881424 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2e7d5093-175f-4978-8e22-f4747e253d9e req-69ec4d0b-b23d-46ac-bfcd-6fbc3aefb801 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494084 Nov 18 21:09:59.779282 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 70619f48-20be-43ef-83b4-c6cd99978c38 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:09:59.892604 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 70619f48-20be-43ef-83b4-c6cd99978c38, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=70619f48-20be-43ef-83b4-c6cd99978c38,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:09:59.904939 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '70619f48-20be-43ef-83b4-c6cd99978c38', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'port_id': '70619f48-20be-43ef-83b4-c6cd99978c38', 'mac_address': 'fa:16:3e:7a:65:47', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 639, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:09:59.954580 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:09:59.971177 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 70619f48-20be-43ef-83b4-c6cd99978c38 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:09:59.994916 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 70619f48-20be-43ef-83b4-c6cd99978c38, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=70619f48-20be-43ef-83b4-c6cd99978c38,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:10:00.003724 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:00.019683 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7053a3f3-5167-4102-977f-f8ec1642301b req-3cb9a92f-d82a-481e-a35d-6dc70a0e49f6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:00.021258 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7053a3f3-5167-4102-977f-f8ec1642301b req-3cb9a92f-d82a-481e-a35d-6dc70a0e49f6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 944 time: 0.0612237 Nov 18 21:10:00.058347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=70619f48-20be-43ef-83b4-c6cd99978c38,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:00.079166 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7053a3f3-5167-4102-977f-f8ec1642301b req-2cab95a4-bab5-44b7-b45e-9fa453467593 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489295 Nov 18 21:10:00.258008 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['70619f48-20be-43ef-83b4-c6cd99978c38'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:10:01.213196 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42234) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:01.218783 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a404c7c7-78ae-4cac-bb0a-08d956357e2d req-c068f440-003f-4f2d-8aa5-4c1ded5130f0 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:01.220612 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a404c7c7-78ae-4cac-bb0a-08d956357e2d req-c068f440-003f-4f2d-8aa5-4c1ded5130f0 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 945 time: 0.0634630 Nov 18 21:10:01.282424 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-a404c7c7-78ae-4cac-bb0a-08d956357e2d req-b426cec9-6d0e-4ebd-98d2-a12c9421105d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0546901 Nov 18 21:10:01.341482 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.418754 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.422468 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.460804 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=87b5206c-8e96-43f2-86a7-21a1f8ccf9bf,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:01.464999 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3ef81070bcef41d78dc007b144a4723a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2505929 Nov 18 21:10:01.467902 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 42238) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:01.471532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.471901 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.472264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.472606 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.472941 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.473277 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.473618 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.473953 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.474284 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.474617 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.474941 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.475398 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1c6ec8e4-05ab-4876-aef9-9e9c300236f0 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:10:01.519153 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-288aaa52-982f-4a38-a15f-5997ee42da07 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.540096 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-288aaa52-982f-4a38-a15f-5997ee42da07 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.589418 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-288aaa52-982f-4a38-a15f-5997ee42da07 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.592286 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-288aaa52-982f-4a38-a15f-5997ee42da07 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.593432 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-288aaa52-982f-4a38-a15f-5997ee42da07 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/87b5206c-8e96-43f2-86a7-21a1f8ccf9bf HTTP/1.1" status: 204 len: 168 time: 0.1245232 Nov 18 21:10:01.602297 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-288aaa52-982f-4a38-a15f-5997ee42da07 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=87b5206c-8e96-43f2-86a7-21a1f8ccf9bf,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:01.791757 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 70619f48-20be-43ef-83b4-c6cd99978c38 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:10:01.845465 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 70619f48-20be-43ef-83b4-c6cd99978c38 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:10:01.850309 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 70619f48-20be-43ef-83b4-c6cd99978c38 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:10:01.850695 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.943381 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:01.969310 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:10:01.971838 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-84abd07f-4989-4cba-aa25-ab358888cd7b" -d '{"events": [{"server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "name": "network-vif-plugged", "status": "completed", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:10:01.985701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 70619f48-20be-43ef-83b4-c6cd99978c38, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=70619f48-20be-43ef-83b4-c6cd99978c38,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:10:01.991439 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:02.016311 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:10:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5616f71b-10c9-49fc-85aa-4784e3945931 x-openstack-request-id: req-5616f71b-10c9-49fc-85aa-4784e3945931 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:10:02.016633 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "name": "network-vif-plugged", "status": "completed", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:10:02.016864 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-5616f71b-10c9-49fc-85aa-4784e3945931 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:10:02.017246 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38', 'code': 200} Nov 18 21:10:02.056688 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=70619f48-20be-43ef-83b4-c6cd99978c38,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:02.205403 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-2e0885d5-86a2-46eb-b4fe-3dee82fe6b41 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:02.278111 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e113c04f-cd30-4ccf-927a-813f33f3f013 req-25573346-f187-4704-9b56-0509e13cad80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:02.279654 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e113c04f-cd30-4ccf-927a-813f33f3f013 req-25573346-f187-4704-9b56-0509e13cad80 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1099 time: 0.0502784 Nov 18 21:10:02.333995 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e113c04f-cd30-4ccf-927a-813f33f3f013 req-1f282de3-b896-4421-9d21-1240830ba15c service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457029 Nov 18 21:10:02.417190 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-978f398b-2a0d-457b-af1e-c733c7f87ca7 req-f068058c-60a2-4643-8f2e-eeb85c98b931 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:02.418726 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-978f398b-2a0d-457b-af1e-c733c7f87ca7 req-f068058c-60a2-4643-8f2e-eeb85c98b931 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0595231 Nov 18 21:10:02.475556 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-978f398b-2a0d-457b-af1e-c733c7f87ca7 req-f633e52f-d5d4-4af1-bb88-bc589ef6a813 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485685 Nov 18 21:10:03.613359 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534e3f33-41a1-40b7-a08a-bb85584405be req-d1df59f9-a731-414c-842a-e79c9171c35b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:03.614943 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-534e3f33-41a1-40b7-a08a-bb85584405be req-d1df59f9-a731-414c-842a-e79c9171c35b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0586376 Nov 18 21:10:03.701627 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-534e3f33-41a1-40b7-a08a-bb85584405be req-fffa2289-88ce-4c70-8d14-afc8ccafa0a4 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0764244 Nov 18 21:10:04.637651 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-00365c44-760c-4aa9-9bc3-d7454ea34d52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:04.855444 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1bac0428-f58e-4d65-b268-0c8dc26e58a8 req-f498a9fa-474a-4eac-970b-2b5cd65a3eaf tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:04.857290 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1bac0428-f58e-4d65-b268-0c8dc26e58a8 req-f498a9fa-474a-4eac-970b-2b5cd65a3eaf tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0763283 Nov 18 21:10:04.922401 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1bac0428-f58e-4d65-b268-0c8dc26e58a8 req-eeb9bc3f-9cc9-4657-96d9-f1da5952ffd9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0559261 Nov 18 21:10:05.053631 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-768b2a5b-12cf-4782-b86c-575feadec220 req-bbee0b7e-bd6a-436f-b7ac-76313d886a51 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:05.055177 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-768b2a5b-12cf-4782-b86c-575feadec220 req-bbee0b7e-bd6a-436f-b7ac-76313d886a51 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0567374 Nov 18 21:10:05.113787 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-768b2a5b-12cf-4782-b86c-575feadec220 req-3c0f78cc-23ae-4de7-9140-bc32f0ca9439 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0509691 Nov 18 21:10:05.139388 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42338) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:05.368086 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-976b2d28-73c6-4ba0-b601-13c7c0a81698 tempest-TestVolumeBootPattern-1091376469 tempest-TestVolumeBootPattern-1091376469-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:05.371528 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-976b2d28-73c6-4ba0-b601-13c7c0a81698 tempest-TestVolumeBootPattern-1091376469 tempest-TestVolumeBootPattern-1091376469-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1094 time: 0.2300999 Nov 18 21:10:05.373623 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42342) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:05.378143 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'port_id': '70619f48-20be-43ef-83b4-c6cd99978c38', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address': '172.20.0.12'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:10:05.401592 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:05.527435 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:05.647754 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Allocated IP 172.27.3.117 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/dd2b315a-acef-4657-8a9e-1ffb8f65f753) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:10:05.771515 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:05.811607 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:05.858038 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:10:05.864168 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:10:05.868363 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:10:05.875128 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=dd2b315a-acef-4657-8a9e-1ffb8f65f753,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:06.037610 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:06.300370 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:06.377103 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:06.569104 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:06.575324 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:06.654448 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=dd2b315a-acef-4657-8a9e-1ffb8f65f753,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:06.670139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:06.786799 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Floating IP 4bf11b18-f117-4ce3-b18f-24d4f932b180 associated. External IP: 172.27.3.117, port: 70619f48-20be-43ef-83b4-c6cd99978c38. Nov 18 21:10:06.801719 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:10:07.325641 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:10:07.441802 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:10:07.452321 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:10:07.464537 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:10:07.466456 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:10:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:07.471565 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:07.478576 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:07.513785 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-22e654f0-fe97-40de-a706-cba5a309c6a5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.1382229 Nov 18 21:10:07.513785 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:10:07.516463 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-272a24e0-c8b1-46f6-9f5c-b63a299337ea" -d '{"events": [{"name": "network-changed", "server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:10:07.561451 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:10:07 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34e91c05-4cca-46b3-b7a2-e66973f0f777 x-openstack-request-id: req-34e91c05-4cca-46b3-b7a2-e66973f0f777 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:10:07.561823 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:10:07.562190 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-34e91c05-4cca-46b3-b7a2-e66973f0f777 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:10:07.562680 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38', 'status': 'completed', 'code': 200} Nov 18 21:10:07.597044 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:10:07.640671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-19ddbc87-ceb1-422f-83ea-518732685cbb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:07.642731 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-19ddbc87-ceb1-422f-83ea-518732685cbb service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1099 time: 0.0505183 Nov 18 21:10:07.751628 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-2b8c196a-fb17-4560-a680-b5837afe0abf service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:07.753205 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-2b8c196a-fb17-4560-a680-b5837afe0abf service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0993681 Nov 18 21:10:07.850528 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-6dcf9135-c77f-46ac-9c49-ba020471c1c0 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=70619f48-20be-43ef-83b4-c6cd99978c38 HTTP/1.1" status: 200 len: 1000 time: 0.0852897 Nov 18 21:10:07.868771 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '4bf11b18-f117-4ce3-b18f-24d4f932b180', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.117', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': '70619f48-20be-43ef-83b4-c6cd99978c38', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:7a:65:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69be415b-5392-4831-ade3-a25149fe0e91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:10:06Z', 'updated_at': '2021-11-18T21:10:06Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:07.921280 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:10:07.934462 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-3ae1d9b4-2da4-4c3a-9c48-567ceafddaf9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:07.935492 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:10:07.936537 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:10:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:07.936892 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-3ae1d9b4-2da4-4c3a-9c48-567ceafddaf9 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0781305 Nov 18 21:10:07.994037 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-97f9e254-894a-424c-9db5-9f97bcff25c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:07.995551 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-97f9e254-894a-424c-9db5-9f97bcff25c8 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0506773 Nov 18 21:10:08.047919 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:10:08.100971 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-93241061-9345-4294-b433-103d6fd385ac service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0973587 Nov 18 21:10:08.240957 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-272a24e0-c8b1-46f6-9f5c-b63a299337ea req-f81ff6cf-0e0b-4ac4-aada-53305e2311ae service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1269984 Nov 18 21:10:08.262984 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:08.334153 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '4bf11b18-f117-4ce3-b18f-24d4f932b180', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.117', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': '70619f48-20be-43ef-83b4-c6cd99978c38', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:7a:65:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69be415b-5392-4831-ade3-a25149fe0e91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:10:06Z', 'updated_at': '2021-11-18T21:10:06Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:08.364406 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-03f574cb-8304-415a-9cf0-9ac937a37564 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '4bf11b18-f117-4ce3-b18f-24d4f932b180', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.117', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': '70619f48-20be-43ef-83b4-c6cd99978c38', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 631, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:7a:65:47', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '69be415b-5392-4831-ade3-a25149fe0e91', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:10:06Z', 'updated_at': '2021-11-18T21:10:06Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:10:08.580875 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e34bcd61-67b3-4020-a4f6-518c902e156c None None] New status for floating IP 4bf11b18-f117-4ce3-b18f-24d4f932b180: ACTIVE {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:10:19.385786 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:32.208963 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-749b547d-4d7d-478e-844b-2f9d5919a38f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:34.640803 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0fa48900-2289-4360-a288-bb73948ecd93 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:36.024945 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.290169 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42542) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:37.403415 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-aa11a4f0-e361-40bc-bf7d-25323697c9b3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.492805 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.503747 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-aa11a4f0-e361-40bc-bf7d-25323697c9b3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.509003 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-aa11a4f0-e361-40bc-bf7d-25323697c9b3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.555813 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa11a4f0-e361-40bc-bf7d-25323697c9b3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f2c98be3-8933-4841-b4fb-95314b722e38,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:37.561340 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-aa11a4f0-e361-40bc-bf7d-25323697c9b3 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=17e49abc7d0d45df950417b522034d38&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2689657 Nov 18 21:10:37.563800 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42546) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:37.624806 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ef04b6c9-8e8e-4a4f-bbcf-c796e4d3cf72 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.647576 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ef04b6c9-8e8e-4a4f-bbcf-c796e4d3cf72 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.703695 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ef04b6c9-8e8e-4a4f-bbcf-c796e4d3cf72 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.706437 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ef04b6c9-8e8e-4a4f-bbcf-c796e4d3cf72 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:37.710435 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-ef04b6c9-8e8e-4a4f-bbcf-c796e4d3cf72 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/f2c98be3-8933-4841-b4fb-95314b722e38 HTTP/1.1" status: 204 len: 168 time: 0.1426151 Nov 18 21:10:37.718032 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ef04b6c9-8e8e-4a4f-bbcf-c796e4d3cf72 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f2c98be3-8933-4841-b4fb-95314b722e38,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:38.246554 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:43.800293 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:10:49.381340 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:52.053690 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a7266db5-3701-4b5a-adc0-80366ba9bdc8 req-59c3ff2f-9ae3-4b47-b057-4f94a46684d4 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:52.055764 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a7266db5-3701-4b5a-adc0-80366ba9bdc8 req-59c3ff2f-9ae3-4b47-b057-4f94a46684d4 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.0660198 Nov 18 21:10:52.127114 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a7266db5-3701-4b5a-adc0-80366ba9bdc8 req-c22965ec-01a9-4814-adc4-60db7e649b2b tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0631685 Nov 18 21:10:53.251952 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5185e59a-9e84-42e7-a65a-326ad12b42d5 req-88f21ef4-0890-4d31-98b8-beca70abeaaf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:53.253529 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5185e59a-9e84-42e7-a65a-326ad12b42d5 req-88f21ef4-0890-4d31-98b8-beca70abeaaf tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.0515108 Nov 18 21:10:53.310145 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5185e59a-9e84-42e7-a65a-326ad12b42d5 req-08cec232-20c6-41d7-84f2-5d37b580f228 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499780 Nov 18 21:10:53.706628 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-fd9f3635-8975-4f8e-a0e7-59a0eecd238e service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0505152 Nov 18 21:10:53.822987 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-2904306d-4c39-4a5b-89b6-5ad31abe1826 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:53.824562 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-2904306d-4c39-4a5b-89b6-5ad31abe1826 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1099 time: 0.0532777 Nov 18 21:10:53.960086 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-85d5784b-2c26-4326-b34e-93f535f50178 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:53.961535 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-85d5784b-2c26-4326-b34e-93f535f50178 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.1165040 Nov 18 21:10:53.985071 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-18d2be87-57af-436f-bc4f-2728aa127807 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:53.986502 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-18d2be87-57af-436f-bc4f-2728aa127807 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.0678627 Nov 18 21:10:54.089122 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-db81aeda-7e87-4265-b4db-4af7b3de637a service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=70619f48-20be-43ef-83b4-c6cd99978c38 HTTP/1.1" status: 200 len: 1002 time: 0.1194704 Nov 18 21:10:54.152477 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-b4ffe90d-8646-4867-8487-e336abcb1ba3 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:54.153920 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-b4ffe90d-8646-4867-8487-e336abcb1ba3 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0553448 Nov 18 21:10:54.156766 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Deleting port 1868920b-7e7f-4f3c-8425-37348e29ece7 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:10:54.157104 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:54.270081 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-1c2f0524-4ac8-4bcd-9c9f-e66a8808524b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:54.271478 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-1c2f0524-4ac8-4bcd-9c9f-e66a8808524b service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1007318 Nov 18 21:10:54.278577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] For port 1868920b-7e7f-4f3c-8425-37348e29ece7, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=1868920b-7e7f-4f3c-8425-37348e29ece7,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:10:54.278941 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:54.285441 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-238176d1-f21d-49fa-930c-a5a865c02e6f service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102669) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:10:54.286395 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-238176d1-f21d-49fa-930c-a5a865c02e6f service neutron] 10.222.0.62 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049343 Nov 18 21:10:54.537082 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3993a497-8f82-4a69-97b0-bacce2a46db4 req-cf3d630b-571f-4ce5-9b6a-bbe743538736 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:10:54.538440 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3993a497-8f82-4a69-97b0-bacce2a46db4 req-cf3d630b-571f-4ce5-9b6a-bbe743538736 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/ports?device_id=8881078e-5419-4934-91a6-012b5d902c21 HTTP/1.1" status: 200 len: 945 time: 0.1533945 Nov 18 21:10:54.546870 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-124b2fb5-bf76-40e9-9ccb-dece6297bf6b service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2499840 Nov 18 21:10:54.586215 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:54.586569 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:54.586883 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Floating IP 427dba68-c9a5-4d11-aeb3-c86d0965e8ce disassociated. External IP: 172.27.3.220, port: 1868920b-7e7f-4f3c-8425-37348e29ece7. Nov 18 21:10:54.587217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Calling delete_port for 1868920b-7e7f-4f3c-8425-37348e29ece7 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:10:54.649017 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3993a497-8f82-4a69-97b0-bacce2a46db4 req-e608f599-7554-4a46-b2ec-73b86cd1cc11 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups?id=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1040373 Nov 18 21:10:54.756394 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3ca4bc24-9bad-4728-88a5-95e3957b984b req-871a16a8-b648-4604-b0f7-b5196c35ae6d service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1989424 Nov 18 21:10:54.811591 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:54.841802 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event deleted for resources: {'Port': ['ID=1868920b-7e7f-4f3c-8425-37348e29ece7,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:54.955564 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:10:55.063663 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:10:55.073157 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:10:55.082775 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:10:55.083380 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:10:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:55.104338 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] No DVR routers for this DVR port 1868920b-7e7f-4f3c-8425-37348e29ece7 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:10:55.106857 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:55.110456 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-6aabfeea-9d65-4784-b100-83c56c8d8c2e req-dc05c0bd-24a9-4cca-8144-b966fae56591 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.62 "DELETE /v2.0/ports/1868920b-7e7f-4f3c-8425-37348e29ece7 HTTP/1.1" status: 204 len: 173 time: 1.0965488 Nov 18 21:10:55.110913 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'name': 'network-vif-deleted', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:10:55.113153 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-83b4dc5e-d604-4d9e-aa0f-ca2e1443eb92" -d '{"events": [{"server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "name": "network-vif-deleted", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:10:55.158575 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:10:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-798aaa83-c57d-4c3d-9b26-fa0afbbe71ce x-openstack-request-id: req-798aaa83-c57d-4c3d-9b26-fa0afbbe71ce {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:10:55.158873 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8881078e-5419-4934-91a6-012b5d902c21", "name": "network-vif-deleted", "tag": "1868920b-7e7f-4f3c-8425-37348e29ece7", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:10:55.159731 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-798aaa83-c57d-4c3d-9b26-fa0afbbe71ce {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:10:55.160421 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8881078e-5419-4934-91a6-012b5d902c21', 'name': 'network-vif-deleted', 'tag': '1868920b-7e7f-4f3c-8425-37348e29ece7', 'status': 'completed', 'code': 200} Nov 18 21:10:55.202777 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:10:55.425783 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:55.455034 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:10:55.465570 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:10:55.466287 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:10:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:55.582679 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:10:55.738166 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42666) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:55.795234 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c833018-9783-4bec-ac60-060ef5aedc62 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:55.819260 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c833018-9783-4bec-ac60-060ef5aedc62 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:55.867997 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c833018-9783-4bec-ac60-060ef5aedc62 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:55.870636 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-6c833018-9783-4bec-ac60-060ef5aedc62 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:55.871788 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-6c833018-9783-4bec-ac60-060ef5aedc62 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "DELETE /v2.0/security-groups/5a6d04a6-1d94-4022-ab15-72ac89f4a7e3 HTTP/1.1" status: 204 len: 168 time: 0.1325309 Nov 18 21:10:55.874717 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 42668) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:55.880924 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c833018-9783-4bec-ac60-060ef5aedc62 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=5a6d04a6-1d94-4022-ab15-72ac89f4a7e3,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:55.893580 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:10:55.902388 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.api.v2.resource [None req-0ddfba92-d07e-4f27-94e9-7c047d3913a0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] show failed (client error): The resource could not be found. Nov 18 21:10:55.906528 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-0ddfba92-d07e-4f27-94e9-7c047d3913a0 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "GET /v2.0/security-groups/5a6d04a6-1d94-4022-ab15-72ac89f4a7e3 HTTP/1.1" status: 404 len: 347 time: 0.0306468 Nov 18 21:10:55.906863 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42670) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:10:55.923541 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c521ffea-a186-4647-a1d0-17cc2c77a7a1 None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:05:43Z', 'revision_number': 4, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': '55f31c46-aa8c-4f73-a58c-bf8a9c401ffd', 'name': '', 'network_id': 'b99d0e78-8d9d-4599-8cb9-01e271840ab6', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'mac_address': 'fa:16:3e:e9:da:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_interface', 'standard_attr_id': 487, 'fixed_ips': [{'subnet_id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:42Z', 'updated_at': '2021-11-18T21:05:49Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'subnets': [{'id': 'fff76f80-c70a-413a-aadb-600c993bbf6b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:10:56.035315 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Deleting port 5f1da3ab-5273-4b8a-b58d-4c59e6adb5d2 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:10:56.035713 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:56.121564 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:56.121922 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:56.136566 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Calling delete_port for 5f1da3ab-5273-4b8a-b58d-4c59e6adb5d2 owned by network:floatingip {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:10:56.141360 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2ac931c8-157d-484d-8bfc-d8c9ae0b5913 None None] New status for floating IP 427dba68-c9a5-4d11-aeb3-c86d0965e8ce: DOWN {{(pid=102671) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:10:56.300339 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:56.329114 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Pushing event deleted for resources: {'Port': ['ID=5f1da3ab-5273-4b8a-b58d-4c59e6adb5d2,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:10:56.387019 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks [] for floatingip, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:56.389711 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:10:56.390865 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-405d8066-fcb3-4c4b-b78e-ac4a4a257822 tempest-AttachVolumeTestJSON-231199212 tempest-AttachVolumeTestJSON-231199212-project] 10.222.0.61 "DELETE /v2.0/floatingips/427dba68-c9a5-4d11-aeb3-c86d0965e8ce HTTP/1.1" status: 204 len: 168 time: 0.4830256 Nov 18 21:10:58.067898 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1868920b-7e7f-4f3c-8425-37348e29ece7 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:10:58.093006 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 1868920b-7e7f-4f3c-8425-37348e29ece7 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:10:58.093347 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 1868920b-7e7f-4f3c-8425-37348e29ece7 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:10:59.910486 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42698) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:00.351054 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:00.876433 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Deleting port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:11:00.876769 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:00.955755 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] For port 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:11:00.956471 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:00.968861 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Calling delete_port for 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd owned by network:router_interface {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:11:01.144170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:01.177886 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Pushing event deleted for resources: {'Port': ['ID=55f31c46-aa8c-4f73-a58c-bf8a9c401ffd,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:01.336696 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:01.546689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Router 026270c0-4694-40c1-b821-e8e67ee0d2c7 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:11:01.651437 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:11:01.656439 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-57d01ad2-ab60-4abc-8b97-a2b2e4cb8f11 admin admin] 10.222.0.61 "PUT /v2.0/routers/026270c0-4694-40c1-b821-e8e67ee0d2c7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7448621 Nov 18 21:11:01.658975 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42702) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:01.660538 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] Sync routers for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:11:01.671555 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:11:01.672198 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:10:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:01.768565 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks [] for router, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:01.779635 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:11:01.875328 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:01.927967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Deleting port 2d7610ac-5a58-409b-9013-dd34ef29c6c6 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:11:01.928344 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:01.964523 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47'}], 'enable_snat': True}, 'gw_port_id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:11:01Z', 'revision_number': 5, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port': {'id': '2d7610ac-5a58-409b-9013-dd34ef29c6c6', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:72:18:1f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 473, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.47', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:05:39Z', 'updated_at': '2021-11-18T21:05:48Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:01.991002 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] Checking router: 026270c0-4694-40c1-b821-e8e67ee0d2c7 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:11:02.000596 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] Routers {'026270c0-4694-40c1-b821-e8e67ee0d2c7'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:11:02.001274 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:10:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['026270c0-4694-40c1-b821-e8e67ee0d2c7'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:02.014125 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] For port 2d7610ac-5a58-409b-9013-dd34ef29c6c6, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=2d7610ac-5a58-409b-9013-dd34ef29c6c6,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:11:02.014708 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.027798 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Calling delete_port for 2d7610ac-5a58-409b-9013-dd34ef29c6c6 owned by network:router_gateway {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:11:02.089052 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] Set router 026270c0-4694-40c1-b821-e8e67ee0d2c7 gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:11:02.143297 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:11:01Z', 'revision_number': 6, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:02.169543 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b64c2c62-7d1a-48ae-aa75-76444b8faa81 None None] The sync data for ids ['026270c0-4694-40c1-b821-e8e67ee0d2c7'] in dv-cinder-799871-8-iscsi is: [{'id': '026270c0-4694-40c1-b821-e8e67ee0d2c7', 'name': 'tempest-AttachVolumeTestJSON-191819174-router', 'tenant_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:05:38Z', 'updated_at': '2021-11-18T21:11:01Z', 'revision_number': 6, 'project_id': 'c3bcf8e1cce94073aab8b79c5acafab3', 'gw_port_host': None}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:11:02.207080 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.214611 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9601675b-27f7-4a95-be04-bbac59f8eb70 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.236357 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Pushing event deleted for resources: {'Port': ['ID=2d7610ac-5a58-409b-9013-dd34ef29c6c6,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:02.247034 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.247382 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.247752 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.248088 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.248948 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.248948 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.249243 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.249416 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.249730 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.250054 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.250372 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.250692 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:02.309436 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.399497 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.401810 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.444939 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.445498 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 026270c0-4694-40c1-b821-e8e67ee0d2c7 {{(pid=102669) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:11:02.451120 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.452322 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7264437e-45a4-4819-bd5b-d32329062a23 admin admin] 10.222.0.61 "DELETE /v2.0/routers/026270c0-4694-40c1-b821-e8e67ee0d2c7 HTTP/1.1" status: 204 len: 168 time: 0.7921848 Nov 18 21:11:02.454920 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42704) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:02.502689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Deleting subnet fff76f80-c70a-413a-aadb-600c993bbf6b {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:11:02.505765 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.540787 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.620799 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.674880 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.701126 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=fff76f80-c70a-413a-aadb-600c993bbf6b,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:02.703073 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.706315 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-460006ef-74ca-40f7-9447-fd0c7d357209 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/fff76f80-c70a-413a-aadb-600c993bbf6b HTTP/1.1" status: 204 len: 168 time: 0.2505145 Nov 18 21:11:02.707633 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b4d277ae-5ebc-4c0e-9253-929268e98537 None None] Network b99d0e78-8d9d-4599-8cb9-01e271840ab6 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:11:02.708786 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42706) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:02.776496 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.836584 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Deleting port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:11:02.836927 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.909706 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] For port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,segment=NetworkSegment(efaeced5-9640-4392-842a-6c363cdec428),segment_id=efaeced5-9640-4392-842a-6c363cdec428)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:11:02.910171 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:02.925286 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Calling delete_port for 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c owned by network:dhcp {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:11:03.012450 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.022325 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-f147312d-6b78-46d3-98bf-26dd7a70a4fc None None] DHCP port deletion for b99d0e78-8d9d-4599-8cb9-01e271840ab6 request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:11:03.038765 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Pushing event deleted for resources: {'Port': ['ID=4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:03.051496 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] No DVR routers for this DVR port 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c on host dv-cinder-799871-8-iscsi {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:11:03.126776 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.147681 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['b99d0e78-8d9d-4599-8cb9-01e271840ab6']}} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:03.158651 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'efaeced5-9640-4392-842a-6c363cdec428') {'for_net_delete': True} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:03.158953 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.services.segments.db [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'efaeced5-9640-4392-842a-6c363cdec428') {} {{(pid=102669) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:11:03.168720 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5774120'] for segment, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.186533 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.193103 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Releasing vlan 635 on physical network physnet1 to pool {{(pid=102669) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:11:03.193586 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5320355'] for segment, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: Traceback (most recent call last): Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: timer() Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: cb(*args, **kw) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: return func(*args, **kwargs) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: self._notify() Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: self.callback(batched_events) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: event.method(event) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: return f(self, *a, **k) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._get(url).json() Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: return self.request(url, 'GET', **kwargs) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:11:03.195345 dv-cinder-799871-8-iscsi neutron-server[102669]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:11:03.256539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.263692 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.267052 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] 10.222.0.61 "DELETE /v2.0/networks/b99d0e78-8d9d-4599-8cb9-01e271840ab6 HTTP/1.1" status: 204 len: 168 time: 0.5571294 Nov 18 21:11:03.277066 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a9663da9-8bc0-450c-a3ec-10a2b1b2f727 admin admin] Pushing event deleted for resources: {'Network': ['ID=b99d0e78-8d9d-4599-8cb9-01e271840ab6,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:03.382806 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42710) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:03.424992 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f93e0e85-595e-4486-82e5-ea87d36e9725 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=c3bcf8e1cce94073aab8b79c5acafab3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0409408 Nov 18 21:11:03.427476 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 42712) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:03.478659 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9a3bbb73-6846-484f-a264-c5bae1fe1d40 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.499264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9a3bbb73-6846-484f-a264-c5bae1fe1d40 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.545430 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9a3bbb73-6846-484f-a264-c5bae1fe1d40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.548068 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-9a3bbb73-6846-484f-a264-c5bae1fe1d40 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:03.549253 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-9a3bbb73-6846-484f-a264-c5bae1fe1d40 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/c94781e2-0893-440f-b61d-1258197fd8c5 HTTP/1.1" status: 204 len: 168 time: 0.1205454 Nov 18 21:11:03.561977 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9a3bbb73-6846-484f-a264-c5bae1fe1d40 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c94781e2-0893-440f-b61d-1258197fd8c5,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:03.981714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:11:04.003084 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:11:04.003507 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 55f31c46-aa8c-4f73-a58c-bf8a9c401ffd not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:11:04.004000 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 2d7610ac-5a58-409b-9013-dd34ef29c6c6 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:11:04.026855 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 2d7610ac-5a58-409b-9013-dd34ef29c6c6 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:11:04.027273 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 2d7610ac-5a58-409b-9013-dd34ef29c6c6 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:11:04.027827 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:11:04.048375 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:11:04.048728 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 4f69489e-bc9f-4fc3-84d2-4ad976eb1f4c not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:11:04.642846 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fdcead19-ffe0-4475-9210-7a02595cdf99 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:06.028003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:07.483996 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:08.249568 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:19.381464 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:20.799720 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:11:32.218358 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-52d2c96b-02dc-4b78-81d7-7b48819b35cf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:34.656585 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-29ea29ae-2d03-4eda-b280-abe0da3878f0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:36.030787 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:37.485866 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:38.252252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.277692 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43086) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:43.382844 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f8f3d53c-9e07-455d-959e-7896d0bcaaa9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.467667 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f8f3d53c-9e07-455d-959e-7896d0bcaaa9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.471674 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f8f3d53c-9e07-455d-959e-7896d0bcaaa9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.508877 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f8f3d53c-9e07-455d-959e-7896d0bcaaa9 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3871dc309d96480a8da307b35b33a6df&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2301362 Nov 18 21:11:43.511308 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8f3d53c-9e07-455d-959e-7896d0bcaaa9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=468a8f73-93d2-4c10-9a13-82fd19b319be,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:43.511772 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43090) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:43.561124 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.582428 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.633305 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.636238 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.637376 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/468a8f73-93d2-4c10-9a13-82fd19b319be HTTP/1.1" status: 204 len: 168 time: 0.1236560 Nov 18 21:11:43.645296 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=468a8f73-93d2-4c10-9a13-82fd19b319be,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:43.653553 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.653910 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.654246 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.654580 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.654912 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.655241 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.655568 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.655895 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.656260 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.656584 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.656906 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.657223 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7291122c-e184-4c0c-afa7-e67cbca51006 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:11:43.897276 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43096) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:43.910706 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce508514-892f-4506-9fb2-eb4a0f48d752 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.983193 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce508514-892f-4506-9fb2-eb4a0f48d752 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:43.986690 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-ce508514-892f-4506-9fb2-eb4a0f48d752 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:44.034066 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ce508514-892f-4506-9fb2-eb4a0f48d752 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=3d91e65297e04879b0fe0c69dd333e0e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1356962 Nov 18 21:11:44.035051 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce508514-892f-4506-9fb2-eb4a0f48d752 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0a327f3a-5c5f-4685-8a75-36ab4056df7d,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:44.036730 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43098) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:44.089077 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1b487ae-7bcd-44bc-b17e-1df1305e3b3c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:44.110086 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1b487ae-7bcd-44bc-b17e-1df1305e3b3c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:44.157531 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1b487ae-7bcd-44bc-b17e-1df1305e3b3c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:44.160157 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-c1b487ae-7bcd-44bc-b17e-1df1305e3b3c admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:44.161341 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-c1b487ae-7bcd-44bc-b17e-1df1305e3b3c admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/0a327f3a-5c5f-4685-8a75-36ab4056df7d HTTP/1.1" status: 204 len: 168 time: 0.1234541 Nov 18 21:11:44.169053 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1b487ae-7bcd-44bc-b17e-1df1305e3b3c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0a327f3a-5c5f-4685-8a75-36ab4056df7d,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:49.040879 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43192) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:49.146923 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f73a73df-2bdb-452f-a7e0-9d13cf5ecd14 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.221007 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f73a73df-2bdb-452f-a7e0-9d13cf5ecd14 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.225469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-f73a73df-2bdb-452f-a7e0-9d13cf5ecd14 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.267295 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-f73a73df-2bdb-452f-a7e0-9d13cf5ecd14 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1faf613576914cd0b3693d7b2f831db9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2252829 Nov 18 21:11:49.268324 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f73a73df-2bdb-452f-a7e0-9d13cf5ecd14 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a5d049a-49a1-4234-bde0-54238d8d9cfb,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:49.270025 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43196) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:49.320989 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5f93fcf6-5e5e-45e4-8a5d-580ee4a42adf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.343604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5f93fcf6-5e5e-45e4-8a5d-580ee4a42adf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.379823 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.395064 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5f93fcf6-5e5e-45e4-8a5d-580ee4a42adf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.397898 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-5f93fcf6-5e5e-45e4-8a5d-580ee4a42adf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.399049 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-5f93fcf6-5e5e-45e4-8a5d-580ee4a42adf admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/4a5d049a-49a1-4234-bde0-54238d8d9cfb HTTP/1.1" status: 204 len: 168 time: 0.1271424 Nov 18 21:11:49.407777 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f93fcf6-5e5e-45e4-8a5d-580ee4a42adf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a5d049a-49a1-4234-bde0-54238d8d9cfb,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:49.672959 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43202) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:49.687591 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e3440905-aada-4e2f-b208-3b778b4eaf3a admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.780606 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e3440905-aada-4e2f-b208-3b778b4eaf3a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.789264 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-e3440905-aada-4e2f-b208-3b778b4eaf3a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.828870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3440905-aada-4e2f-b208-3b778b4eaf3a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1da4d3a9-d466-44c0-83a4-9da2e971725f,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:49.836045 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-e3440905-aada-4e2f-b208-3b778b4eaf3a admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=b67ccee3ea7f40318fa5fa4d2e0651b9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1618137 Nov 18 21:11:49.838952 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43204) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:49.891950 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a405f8f1-2e09-46e5-8ac7-5936d2ee906b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.913775 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a405f8f1-2e09-46e5-8ac7-5936d2ee906b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.966094 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a405f8f1-2e09-46e5-8ac7-5936d2ee906b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.969641 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a405f8f1-2e09-46e5-8ac7-5936d2ee906b admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:49.971641 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a405f8f1-2e09-46e5-8ac7-5936d2ee906b admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1da4d3a9-d466-44c0-83a4-9da2e971725f HTTP/1.1" status: 204 len: 168 time: 0.1311545 Nov 18 21:11:49.981736 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a405f8f1-2e09-46e5-8ac7-5936d2ee906b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1da4d3a9-d466-44c0-83a4-9da2e971725f,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:55.700222 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-6f955ed4-0a6a-46a3-a3c8-eb95ee33eadd service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0481083 Nov 18 21:11:55.709937 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43286) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:55.800224 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458caff4-fe86-438e-927e-a37577c24271 req-55b28648-48b5-458b-8a8b-bbd6735376b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:11:55.801843 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-55b28648-48b5-458b-8a8b-bbd6735376b6 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 1099 time: 0.0517573 Nov 18 21:11:55.832462 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34bf3e82-2b0d-4747-95b7-990438d6c8de admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:55.920494 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34bf3e82-2b0d-4747-95b7-990438d6c8de admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:55.927174 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-34bf3e82-2b0d-4747-95b7-990438d6c8de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:55.928465 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458caff4-fe86-438e-927e-a37577c24271 req-73c03f7a-ddb0-4273-a5fa-9c928be7dd20 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:11:55.930118 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-73c03f7a-ddb0-4273-a5fa-9c928be7dd20 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.1030905 Nov 18 21:11:55.962110 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-34bf3e82-2b0d-4747-95b7-990438d6c8de admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1acc4138-0ebd-49c3-877c-eeec9e1fc63d,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:55.980660 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-34bf3e82-2b0d-4747-95b7-990438d6c8de admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=7144bdfa341b41ecad38072a65353663&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2695746 Nov 18 21:11:55.982642 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43290) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:56.010263 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-d63ef35f-f391-4f13-ab6a-4aef84f90075 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=70619f48-20be-43ef-83b4-c6cd99978c38 HTTP/1.1" status: 200 len: 1002 time: 0.0720489 Nov 18 21:11:56.034094 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d1ba183-231a-4674-ab4d-80788feeeb0f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.055922 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d1ba183-231a-4674-ab4d-80788feeeb0f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.060444 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458caff4-fe86-438e-927e-a37577c24271 req-e02b8aaf-dd4e-4b9b-81af-5292716af208 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:11:56.062259 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-e02b8aaf-dd4e-4b9b-81af-5292716af208 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0433626 Nov 18 21:11:56.106176 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d1ba183-231a-4674-ab4d-80788feeeb0f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.108886 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1d1ba183-231a-4674-ab4d-80788feeeb0f admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.113429 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-1d1ba183-231a-4674-ab4d-80788feeeb0f admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/1acc4138-0ebd-49c3-877c-eeec9e1fc63d HTTP/1.1" status: 204 len: 168 time: 0.1264489 Nov 18 21:11:56.118565 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d1ba183-231a-4674-ab4d-80788feeeb0f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1acc4138-0ebd-49c3-877c-eeec9e1fc63d,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:56.125162 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-458caff4-fe86-438e-927e-a37577c24271 req-1215e977-779f-4174-be16-ee1053d38b34 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:11:56.127760 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-1215e977-779f-4174-be16-ee1053d38b34 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0581169 Nov 18 21:11:56.236061 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-3b78d025-2de9-4676-b4a6-16a4283edabe service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0997388 Nov 18 21:11:56.330773 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-458caff4-fe86-438e-927e-a37577c24271 req-1a685d66-5ed2-48ae-80e5-bd509616e0c3 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872989 Nov 18 21:11:56.403951 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43296) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:56.417066 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f91e3fe7-98a3-4093-9283-62fe51c43aec admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.492334 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f91e3fe7-98a3-4093-9283-62fe51c43aec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.498293 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f91e3fe7-98a3-4093-9283-62fe51c43aec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.538970 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f91e3fe7-98a3-4093-9283-62fe51c43aec admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=92f8479b9b9f429f81ccaa4418bb60f2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1339071 Nov 18 21:11:56.540839 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f91e3fe7-98a3-4093-9283-62fe51c43aec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a729569b-54d1-4558-8c14-f537945d4d7a,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:56.541940 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43298) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:56.591417 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03c1ffda-1f29-4776-8de3-9dfed0524d68 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.612203 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03c1ffda-1f29-4776-8de3-9dfed0524d68 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.657072 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03c1ffda-1f29-4776-8de3-9dfed0524d68 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.659729 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03c1ffda-1f29-4776-8de3-9dfed0524d68 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:56.660904 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-03c1ffda-1f29-4776-8de3-9dfed0524d68 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/a729569b-54d1-4558-8c14-f537945d4d7a HTTP/1.1" status: 204 len: 168 time: 0.1179688 Nov 18 21:11:56.669325 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03c1ffda-1f29-4776-8de3-9dfed0524d68 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a729569b-54d1-4558-8c14-f537945d4d7a,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:57.799469 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:11:58.503094 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43370) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:58.607595 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eb2f95c3-6aff-4fff-b04e-84f65c3fa738 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.679888 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eb2f95c3-6aff-4fff-b04e-84f65c3fa738 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.683860 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eb2f95c3-6aff-4fff-b04e-84f65c3fa738 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.722498 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-eb2f95c3-6aff-4fff-b04e-84f65c3fa738 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=e2a78ee5236046ecb9e44e9c96db865c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2183254 Nov 18 21:11:58.723606 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb2f95c3-6aff-4fff-b04e-84f65c3fa738 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3f9da0e8-84a1-4b80-8f25-ca79c2ccc21a,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:58.725210 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43374) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:58.774496 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0182bd2-360a-4c81-814e-c34cf3ad1bad admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.795054 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0182bd2-360a-4c81-814e-c34cf3ad1bad admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.841054 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0182bd2-360a-4c81-814e-c34cf3ad1bad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.843762 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f0182bd2-360a-4c81-814e-c34cf3ad1bad admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:58.845158 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f0182bd2-360a-4c81-814e-c34cf3ad1bad admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/3f9da0e8-84a1-4b80-8f25-ca79c2ccc21a HTTP/1.1" status: 204 len: 168 time: 0.1186807 Nov 18 21:11:58.852696 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0182bd2-360a-4c81-814e-c34cf3ad1bad admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3f9da0e8-84a1-4b80-8f25-ca79c2ccc21a,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:59.101150 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43380) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:59.114222 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f533e8bd-4316-46ac-b260-3f4783a95b33 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.195306 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f533e8bd-4316-46ac-b260-3f4783a95b33 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.200638 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-f533e8bd-4316-46ac-b260-3f4783a95b33 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.239706 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-f533e8bd-4316-46ac-b260-3f4783a95b33 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=95d0c162c7db46f8813bd783f36b79f3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1374540 Nov 18 21:11:59.240682 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f533e8bd-4316-46ac-b260-3f4783a95b33 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=077e49bd-a9fd-40d9-adf5-c633fe15afcc,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:11:59.242412 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43382) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:11:59.293940 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a7c54937-4a44-435b-b2f0-d6c979437a17 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.315302 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a7c54937-4a44-435b-b2f0-d6c979437a17 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.362934 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a7c54937-4a44-435b-b2f0-d6c979437a17 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.365703 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-a7c54937-4a44-435b-b2f0-d6c979437a17 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:11:59.366837 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-a7c54937-4a44-435b-b2f0-d6c979437a17 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/077e49bd-a9fd-40d9-adf5-c633fe15afcc HTTP/1.1" status: 204 len: 168 time: 0.1234376 Nov 18 21:11:59.375387 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7c54937-4a44-435b-b2f0-d6c979437a17 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=077e49bd-a9fd-40d9-adf5-c633fe15afcc,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:02.219252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-f2f16d63-eb01-4e7b-a77d-0eb16b97a00a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:04.647186 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cab45ff0-63d8-44cf-a74d-c22514ca2831 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:06.033478 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.218207 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43504) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:07.321575 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-221cc38f-fde1-4044-8c5b-26d040146388 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.400154 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-221cc38f-fde1-4044-8c5b-26d040146388 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.404518 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-221cc38f-fde1-4044-8c5b-26d040146388 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.441905 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-221cc38f-fde1-4044-8c5b-26d040146388 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=bdd4d966f98a41579d66f9068bcd47c4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2225914 Nov 18 21:12:07.443832 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-221cc38f-fde1-4044-8c5b-26d040146388 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2987f099-3e5b-4c5a-899a-16c2645fddbe,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:07.444614 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43508) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:07.487354 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.496530 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.519295 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.567653 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.570289 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.571529 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/2987f099-3e5b-4c5a-899a-16c2645fddbe HTTP/1.1" status: 204 len: 168 time: 0.1259241 Nov 18 21:12:07.581935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2987f099-3e5b-4c5a-899a-16c2645fddbe,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:07.589351 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.589759 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.590107 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.590537 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.590891 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.591230 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.591566 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.591890 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.592251 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.592583 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.592910 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.593237 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1666be8f-d73d-456e-815c-056721635beb admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:07.833098 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43514) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:07.846926 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ba92e300-7d2b-473c-8efd-8995318ed164 admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.920845 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ba92e300-7d2b-473c-8efd-8995318ed164 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.924459 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-ba92e300-7d2b-473c-8efd-8995318ed164 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:07.962979 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-ba92e300-7d2b-473c-8efd-8995318ed164 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=fb5288e81cb44db890a77aff4557e945&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1288185 Nov 18 21:12:07.965032 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba92e300-7d2b-473c-8efd-8995318ed164 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9e482782-e398-4a5b-8b21-4aec03800508,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:07.966243 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43516) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:08.014493 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c7cb23-91f0-4415-bab8-3b456ba68fa6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.034820 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c7cb23-91f0-4415-bab8-3b456ba68fa6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.080093 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c7cb23-91f0-4415-bab8-3b456ba68fa6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.082719 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-23c7cb23-91f0-4415-bab8-3b456ba68fa6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.083876 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-23c7cb23-91f0-4415-bab8-3b456ba68fa6 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/9e482782-e398-4a5b-8b21-4aec03800508 HTTP/1.1" status: 204 len: 168 time: 0.1166172 Nov 18 21:12:08.091960 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-23c7cb23-91f0-4415-bab8-3b456ba68fa6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9e482782-e398-4a5b-8b21-4aec03800508,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:08.257824 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.399821 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43522) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:08.413838 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-054d43db-14f6-43ae-acbb-7cdc24f8318c admin admin] Publish callbacks [] for security_group, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.488681 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-054d43db-14f6-43ae-acbb-7cdc24f8318c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.492420 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-054d43db-14f6-43ae-acbb-7cdc24f8318c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.531265 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-054d43db-14f6-43ae-acbb-7cdc24f8318c admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=fb0011edfe8043079d28d747416665a8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1302872 Nov 18 21:12:08.532371 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-054d43db-14f6-43ae-acbb-7cdc24f8318c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=116fd4a3-6458-4586-8334-000f0935e1b6,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:08.534241 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43524) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:08.582702 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-df3006b9-19ea-4b1f-af8d-c485e1e8ac0a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.603930 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-df3006b9-19ea-4b1f-af8d-c485e1e8ac0a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.884460 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-df3006b9-19ea-4b1f-af8d-c485e1e8ac0a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.887743 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-df3006b9-19ea-4b1f-af8d-c485e1e8ac0a admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:08.888896 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-df3006b9-19ea-4b1f-af8d-c485e1e8ac0a admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/116fd4a3-6458-4586-8334-000f0935e1b6 HTTP/1.1" status: 204 len: 168 time: 0.3536780 Nov 18 21:12:08.897164 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df3006b9-19ea-4b1f-af8d-c485e1e8ac0a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=116fd4a3-6458-4586-8334-000f0935e1b6,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:13.088667 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237c0aec-749d-4565-aed5-8adf4234fb2f req-2f831499-6fa9-4539-baee-e74443d9c33d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:13.090152 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-237c0aec-749d-4565-aed5-8adf4234fb2f req-2f831499-6fa9-4539-baee-e74443d9c33d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0516956 Nov 18 21:12:13.142688 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-237c0aec-749d-4565-aed5-8adf4234fb2f req-a3cc8fc1-81f4-4a9d-8bfe-9a1c06868c35 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459759 Nov 18 21:12:14.272596 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-07224c84-323c-4aa5-ab73-bd4761b049ad req-e7dbddd4-03c7-4c9d-b99d-48a3bd87305a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:14.274166 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-07224c84-323c-4aa5-ab73-bd4761b049ad req-e7dbddd4-03c7-4c9d-b99d-48a3bd87305a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0581677 Nov 18 21:12:14.333740 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-07224c84-323c-4aa5-ab73-bd4761b049ad req-f2b73177-91bb-481b-98fe-80e6cef265dc tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515857 Nov 18 21:12:14.707428 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-ec52b36d-853f-4fe4-a8e9-7392229dda21 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:14.707428 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-ec52b36d-853f-4fe4-a8e9-7392229dda21 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 946 time: 0.0520186 Nov 18 21:12:14.802327 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Deleting port 70619f48-20be-43ef-83b4-c6cd99978c38 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:12:14.802669 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:14.900632 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] For port 70619f48-20be-43ef-83b4-c6cd99978c38, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=70619f48-20be-43ef-83b4-c6cd99978c38,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:12:14.901095 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:15.073195 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:15.073611 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:15.073890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Floating IP 4bf11b18-f117-4ce3-b18f-24d4f932b180 disassociated. External IP: 172.27.3.117, port: 70619f48-20be-43ef-83b4-c6cd99978c38. Nov 18 21:12:15.074213 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Calling delete_port for 70619f48-20be-43ef-83b4-c6cd99978c38 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:12:15.210157 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:15.239793 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'Port': ['ID=70619f48-20be-43ef-83b4-c6cd99978c38,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:15.357123 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:12:15.430917 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-96502bf5-5392-4449-8d04-2ebb73728f4e req-5948dc6f-25ea-4148-9c7a-fed0a9efe33c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 210 time: 0.0279019 Nov 18 21:12:15.765364 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:12:15.776669 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:12:15.792963 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:12:15.793811 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:12:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:15.805908 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] No DVR routers for this DVR port 70619f48-20be-43ef-83b4-c6cd99978c38 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:12:15.808557 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:15.812589 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-baf7d484-a749-4ec3-acec-2a13d71bd944 req-af000331-9f36-4271-bc26-be03131f938d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "DELETE /v2.0/ports/70619f48-20be-43ef-83b4-c6cd99978c38 HTTP/1.1" status: 204 len: 173 time: 1.0990772 Nov 18 21:12:15.813063 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'name': 'network-vif-deleted', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:12:15.815364 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0aa9778f-9cb7-4c8d-a420-8ad097da7b2c" -d '{"events": [{"server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "name": "network-vif-deleted", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:12:15.930653 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:12:15.998054 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:12:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c708c635-ec9a-415c-bc2e-274ed9c27f2d x-openstack-request-id: req-c708c635-ec9a-415c-bc2e-274ed9c27f2d {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:12:15.998463 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "69be415b-5392-4831-ade3-a25149fe0e91", "name": "network-vif-deleted", "tag": "70619f48-20be-43ef-83b4-c6cd99978c38", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:12:15.998798 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c708c635-ec9a-415c-bc2e-274ed9c27f2d {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:12:15.999214 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '69be415b-5392-4831-ade3-a25149fe0e91', 'name': 'network-vif-deleted', 'tag': '70619f48-20be-43ef-83b4-c6cd99978c38', 'status': 'completed', 'code': 200} Nov 18 21:12:16.152880 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:16.190677 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:12:16.199714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:12:16.201764 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:12:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:16.319852 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:12:16.594403 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:16.610748 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-4e172d9a-5bf3-4785-84fc-e100d002d589 req-d7f864f0-4f95-4963-b01b-5f1074d79e6c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=69be415b-5392-4831-ade3-a25149fe0e91 HTTP/1.1" status: 200 len: 210 time: 0.0368955 Nov 18 21:12:16.633765 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4ec9be3d-e46f-4148-80a8-ee5839ff700f None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:12:16.840494 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a3c9d6e8-0133-4e21-b868-69a999017b58 None None] New status for floating IP 4bf11b18-f117-4ce3-b18f-24d4f932b180: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:12:17.879818 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6ae4438f-a25c-4c58-8281-10d76046e496 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1633191489&fields=id&tenant_id=97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 267 time: 0.0575430 Nov 18 21:12:17.985357 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-69d93611-ee6c-49ed-8432-f9fe8fbe94b8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:17.986865 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-69d93611-ee6c-49ed-8432-f9fe8fbe94b8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 812 time: 0.1001513 Nov 18 21:12:18.002621 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-bbfe4b6d-50a4-4979-bf5f-5a45a71b0fc0 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/quotas/97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 375 time: 0.0095332 Nov 18 21:12:18.055665 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-c45833e6-1fe1-4915-8c80-2aed79e92b13 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0475588 Nov 18 21:12:18.070968 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-b57474d4-e9f0-4d76-aa5c-b7a7cc911518 service neutron] http://10.222.0.61:9696/v2.0/extensions returned with HTTP 200 {{(pid=102670) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 18 21:12:18.071893 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-b57474d4-e9f0-4d76-aa5c-b7a7cc911518 service neutron] 10.222.0.61 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 14082 time: 0.0049481 Nov 18 21:12:18.165746 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-581d888d-e9f8-42dd-bf5d-d0b2717a8a45 service neutron] 10.222.0.61 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881684 Nov 18 21:12:18.259917 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-5c2ef2d6-307d-48c8-953e-acf9f9d39efe service neutron] 10.222.0.61 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0872552 Nov 18 21:12:18.477493 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 70619f48-20be-43ef-83b4-c6cd99978c38 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:12:18.515478 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 70619f48-20be-43ef-83b4-c6cd99978c38 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:12:18.515804 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 70619f48-20be-43ef-83b4-c6cd99978c38 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:12:18.547866 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-21f41452-acd7-49ad-b338-c41f2342d5a0 req-e9331d6c-bf06-457d-a74a-a0818c000805 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0273952 Nov 18 21:12:19.377431 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:19.637905 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f8aa6816-6ae3-47f5-8372-e297db840b6a req-8e54f3da-4ceb-4406-8270-9d10faca45c5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0326614 Nov 18 21:12:19.872445 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43702) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:19.976503 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7068e74-5877-43e5-ad6e-2806b771261e admin admin] Publish callbacks [] for security_group, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.053509 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7068e74-5877-43e5-ad6e-2806b771261e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.057258 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e7068e74-5877-43e5-ad6e-2806b771261e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.095811 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-e7068e74-5877-43e5-ad6e-2806b771261e admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=1aaedc20e6be4552b87146c5fad3357f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2220592 Nov 18 21:12:20.096711 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e7068e74-5877-43e5-ad6e-2806b771261e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24c0fa33-c66a-4c1b-88c5-7d5d439b63fe,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:20.098520 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43706) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:20.149534 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eabd8f30-2e1d-4a74-9988-aea3a3e501bf admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.170557 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eabd8f30-2e1d-4a74-9988-aea3a3e501bf admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.217512 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eabd8f30-2e1d-4a74-9988-aea3a3e501bf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.220081 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-eabd8f30-2e1d-4a74-9988-aea3a3e501bf admin admin] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:20.221537 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-eabd8f30-2e1d-4a74-9988-aea3a3e501bf admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/24c0fa33-c66a-4c1b-88c5-7d5d439b63fe HTTP/1.1" status: 204 len: 168 time: 0.1220033 Nov 18 21:12:20.229307 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eabd8f30-2e1d-4a74-9988-aea3a3e501bf admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24c0fa33-c66a-4c1b-88c5-7d5d439b63fe,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:20.712657 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-d6bedb68-7514-43c9-ad48-871f976aea6b req-67bdbc6e-4660-4ac9-89b7-ccd5cf8b171c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0260658 Nov 18 21:12:21.788593 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2734f2d2-b15f-488b-bfed-4b40a6d4176d req-08309cf7-5d34-476f-8f1b-3c87e7b6d2d8 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0258260 Nov 18 21:12:22.879931 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4d8c6791-9375-4925-9830-7acf03fd62e4 req-e79a4832-0706-4ddd-8b85-1b04d63946cd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0261915 Nov 18 21:12:23.651795 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-812ab4d5-0ac9-4a85-b1a6-f11f317c3776 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:23.653279 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-812ab4d5-0ac9-4a85-b1a6-f11f317c3776 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 812 time: 0.1200798 Nov 18 21:12:23.720031 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-2275a73a-ce08-4d83-9c21-f192a630ad5c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 380 time: 0.0557926 Nov 18 21:12:23.730408 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'port': {'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'admin_state_up': True, 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'security_groups': ['05581fc3-f5ff-492a-8f7f-0d168cec3421']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:12:23.845795 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Made reservation on behalf of 97c605960c964eb3960a3f3324bf46bb for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:12:23.849303 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:23.985650 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Allocated IP 172.20.0.11 (e9895462-5764-4a81-a2a3-f5482f05a6a3/a8ffc170-cfa2-4b16-935a-923d6b39dd63/eb59c5f9-17de-415f-9154-1ff6f5903ba6) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:12:23.992314 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-6fb86cfa-4f9c-4a7a-b78c-4f71a83e301e req-6e7cbb27-ac27-4023-9f36-f39bfe1b762a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0400069 Nov 18 21:12:24.136550 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.175140 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.223047 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:12:24.226167 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:12:24.229792 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:12:24.236854 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=eb59c5f9-17de-415f-9154-1ff6f5903ba6,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:24.295755 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:24.297272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.312462 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-6c3c8439-5c87-402f-a660-e33f17ea6fbe tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5857830 Nov 18 21:12:24.328768 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Request body: {'port': {'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:12:24.384186 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.473179 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-3af290c2-cfdd-4eaf-a7b0-db152e435cb5 None None] Provisioning complete for port eb59c5f9-17de-415f-9154-1ff6f5903ba6 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:12:24.473809 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-3af290c2-cfdd-4eaf-a7b0-db152e435cb5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.506252 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-3af290c2-cfdd-4eaf-a7b0-db152e435cb5 None None] Port eb59c5f9-17de-415f-9154-1ff6f5903ba6 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:12:24.652395 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id eb59c5f9-17de-415f-9154-1ff6f5903ba6 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:12:24.660487 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.672772 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Transition to ACTIVE for port object eb59c5f9-17de-415f-9154-1ff6f5903ba6 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:12:24.676469 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.727683 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Pushing event updated for resources: {'Port': ['ID=eb59c5f9-17de-415f-9154-1ff6f5903ba6,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:24.801099 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Attempting to bind port eb59c5f9-17de-415f-9154-1ff6f5903ba6 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:12:24.801573 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Attempting to bind port eb59c5f9-17de-415f-9154-1ff6f5903ba6 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:12:24.801906 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Attempting to bind port eb59c5f9-17de-415f-9154-1ff6f5903ba6 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:12:24.806402 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Port eb59c5f9-17de-415f-9154-1ff6f5903ba6 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:12:24.806717 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Attempting to bind port eb59c5f9-17de-415f-9154-1ff6f5903ba6 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:12:24.811772 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 12, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:12:24.812139 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Checking segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:12:24.812521 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Bound using segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:12:24.812954 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Bound port: eb59c5f9-17de-415f-9154-1ff6f5903ba6, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:12:24.813309 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.882447 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] For port eb59c5f9-17de-415f-9154-1ff6f5903ba6, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:12:24.886005 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] For port eb59c5f9-17de-415f-9154-1ff6f5903ba6, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:12:24.891713 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.933953 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:24.935002 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:24.936556 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] 10.222.0.62 "PUT /v2.0/ports/eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 1094 time: 0.6146262 Nov 18 21:12:24.937053 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:12:24.939371 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12" -d '{"events": [{"name": "network-changed", "server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:12:24.963765 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59254cfa-48d1-425e-8263-af5aa5a53346 service neutron] Pushing event updated for resources: {'Port': ['ID=eb59c5f9-17de-415f-9154-1ff6f5903ba6,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:24.983912 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:12:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9f85cb3d-280e-4f48-80d9-5744c6075843 x-openstack-request-id: req-9f85cb3d-280e-4f48-80d9-5744c6075843 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:12:24.984240 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:12:24.984459 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-9f85cb3d-280e-4f48-80d9-5744c6075843 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:12:24.984866 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'status': 'completed', 'code': 200} Nov 18 21:12:25.033976 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-8de6373f-ed5c-4050-a4e7-f722b27432e5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.035547 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-8de6373f-ed5c-4050-a4e7-f722b27432e5 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1097 time: 0.0451083 Nov 18 21:12:25.085170 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-516deed5-2c3e-40a2-9ae7-96a4cb562170 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 217 time: 0.0372062 Nov 18 21:12:25.122871 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2fd298bc-3383-49e9-b688-82162d2151ce req-14941991-629e-4ec7-8a55-68374151c6fb tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.124607 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2fd298bc-3383-49e9-b688-82162d2151ce req-14941991-629e-4ec7-8a55-68374151c6fb tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0552897 Nov 18 21:12:25.145529 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-b4121a52-ecf8-474d-9677-1434f4984a16 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.146994 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-b4121a52-ecf8-474d-9677-1434f4984a16 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0541675 Nov 18 21:12:25.178914 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-2fd298bc-3383-49e9-b688-82162d2151ce req-cc1f0399-6b5e-40b4-b39e-2f34ee135ccc tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481837 Nov 18 21:12:25.198575 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-21d6bf94-5268-4dcb-bf19-298315ce9c6a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.200830 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-21d6bf94-5268-4dcb-bf19-298315ce9c6a service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437107 Nov 18 21:12:25.289883 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-d4fec67f-42dc-497a-9a71-51c109af3af2 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0808997 Nov 18 21:12:25.384362 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-5d58ee85-ecb6-4219-b5ed-76a430fa6d17 req-586cac8f-7013-45dc-b2e3-a757950d2bc8 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0865684 Nov 18 21:12:25.479368 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-f7a0f87c-2566-4c21-b086-dc4dd13ebda8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.481212 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-f7a0f87c-2566-4c21-b086-dc4dd13ebda8 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1097 time: 0.0450552 Nov 18 21:12:25.579913 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-efb5128e-5d9d-4665-acb3-5fcfe25e10d6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.581562 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-efb5128e-5d9d-4665-acb3-5fcfe25e10d6 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0909486 Nov 18 21:12:25.626455 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-b211114f-c37f-4c03-958f-860c2b9ee2af service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 217 time: 0.0360589 Nov 18 21:12:25.676581 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-d40c5de1-1df2-4bf2-a0b3-4851c2cf332c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.678011 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-d40c5de1-1df2-4bf2-a0b3-4851c2cf332c service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0438049 Nov 18 21:12:25.730068 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-19a1e3df-305b-47cb-bb45-9480685c2cf3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:25.731750 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-19a1e3df-305b-47cb-bb45-9480685c2cf3 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0451298 Nov 18 21:12:25.821769 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-658a7f84-0392-44f8-8495-6e28a4f5682c service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0823770 Nov 18 21:12:25.917462 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7d483bc4-ee65-4321-bc8a-ccbf93ae0d12 req-62e36379-479f-464a-8254-c2859ff6a29a service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0873158 Nov 18 21:12:26.297652 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02e033e6-e9e4-4c83-9617-29dfefcc806c req-60bad872-2790-4364-8a27-9b72a2df13b5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:26.299170 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-02e033e6-e9e4-4c83-9617-29dfefcc806c req-60bad872-2790-4364-8a27-9b72a2df13b5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0502458 Nov 18 21:12:26.348571 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-02e033e6-e9e4-4c83-9617-29dfefcc806c req-572a988a-fb93-4d64-b4f6-57207616f96c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433517 Nov 18 21:12:27.463888 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e3a0cce-62ea-430c-8fdf-30c091296151 req-6b393d00-d43b-4e6f-8aae-e86d57638793 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:27.465362 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e3a0cce-62ea-430c-8fdf-30c091296151 req-6b393d00-d43b-4e6f-8aae-e86d57638793 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0494437 Nov 18 21:12:27.515850 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0e3a0cce-62ea-430c-8fdf-30c091296151 req-425205d6-a30c-4a72-b152-6591ada95c3a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442386 Nov 18 21:12:28.628040 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45b8bd9f-1a19-4b0a-80da-bca3852bfe50 req-720a494d-49e1-4373-9b66-8c0256fdc7ed tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:28.629542 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45b8bd9f-1a19-4b0a-80da-bca3852bfe50 req-720a494d-49e1-4373-9b66-8c0256fdc7ed tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0483999 Nov 18 21:12:28.677743 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45b8bd9f-1a19-4b0a-80da-bca3852bfe50 req-28ddafff-f095-4e29-b3c9-3a9d42075ac2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423255 Nov 18 21:12:29.794863 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e41cb8a3-b43d-4e87-8fb8-3c88d4e29148 req-e3013a12-6524-476d-9937-5982b9efc9c9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:29.796266 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e41cb8a3-b43d-4e87-8fb8-3c88d4e29148 req-e3013a12-6524-476d-9937-5982b9efc9c9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0523279 Nov 18 21:12:29.847144 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-e41cb8a3-b43d-4e87-8fb8-3c88d4e29148 req-bfe6a949-3144-4b50-b787-e0e4e7b752de tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449195 Nov 18 21:12:30.971356 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-97bcf4d8-3437-46b7-909a-77eb68c257ad req-c26a84fd-6007-4a0b-9303-2d8bfa3fc564 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:30.972876 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97bcf4d8-3437-46b7-909a-77eb68c257ad req-c26a84fd-6007-4a0b-9303-2d8bfa3fc564 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0544779 Nov 18 21:12:31.023226 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-97bcf4d8-3437-46b7-909a-77eb68c257ad req-ace32bd9-968e-484f-86b0-3b3833dbf512 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443871 Nov 18 21:12:32.138995 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd32c96b-bf55-4b96-bae6-b24f5c3e666d req-11423e08-798a-42ab-8a47-85dceabb1c8b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:32.141166 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd32c96b-bf55-4b96-bae6-b24f5c3e666d req-11423e08-798a-42ab-8a47-85dceabb1c8b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 944 time: 0.0504529 Nov 18 21:12:32.191064 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-cd32c96b-bf55-4b96-bae6-b24f5c3e666d req-fad02a01-f92a-42df-a7ed-b1d128b6cb39 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0438778 Nov 18 21:12:32.229208 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-75986d78-8127-4abf-8395-7f26911c8ece None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:32.570623 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device eb59c5f9-17de-415f-9154-1ff6f5903ba6 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:12:32.669961 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port eb59c5f9-17de-415f-9154-1ff6f5903ba6, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:12:32.681135 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 639, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:12:32.718116 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:32.730769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id eb59c5f9-17de-415f-9154-1ff6f5903ba6 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:12:32.749182 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port eb59c5f9-17de-415f-9154-1ff6f5903ba6, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:12:32.753073 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:32.805898 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=eb59c5f9-17de-415f-9154-1ff6f5903ba6,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:32.813545 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.813892 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.814230 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.814559 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.814884 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.815210 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.815576 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.815878 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.816246 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.816569 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.816885 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:32.817575 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:12:33.074795 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['eb59c5f9-17de-415f-9154-1ff6f5903ba6'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:12:33.316466 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0a05fb32-70ed-4639-b285-a6a4213acd08 req-e190aeba-3431-4c20-9dcc-94456df1ae05 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:33.318001 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0a05fb32-70ed-4639-b285-a6a4213acd08 req-e190aeba-3431-4c20-9dcc-94456df1ae05 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 945 time: 0.0493245 Nov 18 21:12:33.369993 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-0a05fb32-70ed-4639-b285-a6a4213acd08 req-79483f68-b196-4ee4-92ce-9edc5084b690 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0459869 Nov 18 21:12:34.485893 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26243c9c-1013-4455-8930-98534c7e9e22 req-8d7abb1a-b946-4594-9581-f5819212c7ba tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:34.487354 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-26243c9c-1013-4455-8930-98534c7e9e22 req-8d7abb1a-b946-4594-9581-f5819212c7ba tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 945 time: 0.0490172 Nov 18 21:12:34.540296 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-26243c9c-1013-4455-8930-98534c7e9e22 req-8d9f6fb0-eaa4-4563-a16f-42d6c2ac4373 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0469284 Nov 18 21:12:34.582975 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device eb59c5f9-17de-415f-9154-1ff6f5903ba6 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:12:34.757216 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c5d25633-da45-44d5-9238-0a95b20c5a9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:34.766118 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port eb59c5f9-17de-415f-9154-1ff6f5903ba6 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:12:34.769980 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port eb59c5f9-17de-415f-9154-1ff6f5903ba6 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:12:34.770342 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:34.799643 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:12:34.849334 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:34.875438 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:12:34.877720 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-9028f4bf-02c0-4d6b-ab46-c65efa3372bf" -d '{"events": [{"server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "name": "network-vif-plugged", "status": "completed", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:12:34.890404 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port eb59c5f9-17de-415f-9154-1ff6f5903ba6, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:12:34.894454 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:34.948424 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=eb59c5f9-17de-415f-9154-1ff6f5903ba6,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:35.093417 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:12:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c7c69334-d44f-4186-a169-5538b5361281 x-openstack-request-id: req-c7c69334-d44f-4186-a169-5538b5361281 {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:12:35.093713 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "name": "network-vif-plugged", "status": "completed", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:12:35.093968 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-c7c69334-d44f-4186-a169-5538b5361281 {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:12:35.094371 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'code': 200} Nov 18 21:12:35.312642 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10c67a75-0813-430c-bbca-283e4a0a172a req-8d248442-e367-4d3b-99c3-5b992463d288 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:35.314132 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-10c67a75-0813-430c-bbca-283e4a0a172a req-8d248442-e367-4d3b-99c3-5b992463d288 service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1099 time: 0.0449934 Nov 18 21:12:35.362190 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-10c67a75-0813-430c-bbca-283e4a0a172a req-a8a4eddd-af0b-41b4-be8d-2ef3ac77ca1e service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404143 Nov 18 21:12:35.658190 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7339745c-e5db-48b1-ab0c-fad502f30acc req-360f6f1f-bfe0-4f27-a328-bbfd1a82879b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:35.659745 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7339745c-e5db-48b1-ab0c-fad502f30acc req-360f6f1f-bfe0-4f27-a328-bbfd1a82879b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 946 time: 0.0505781 Nov 18 21:12:35.716880 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-7339745c-e5db-48b1-ab0c-fad502f30acc req-28c3f663-2587-4bf2-a516-115ebdfb88fa tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0510459 Nov 18 21:12:36.036392 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:36.835579 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1178ae7d-fd56-4e23-bb9a-90c3ea353207 req-f51cabe4-5447-488f-8749-34e92b22e5ed tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:36.837171 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1178ae7d-fd56-4e23-bb9a-90c3ea353207 req-f51cabe4-5447-488f-8749-34e92b22e5ed tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 946 time: 0.0502539 Nov 18 21:12:36.888437 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1178ae7d-fd56-4e23-bb9a-90c3ea353207 req-90a886f9-af90-4b1d-af29-42eab8177c0d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451922 Nov 18 21:12:37.005854 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0835a779-2fbc-4b22-b415-c034c8ed6e0a req-85f8426d-8799-43bb-9149-96a41ad95086 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:37.007243 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0835a779-2fbc-4b22-b415-c034c8ed6e0a req-85f8426d-8799-43bb-9149-96a41ad95086 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 946 time: 0.0506313 Nov 18 21:12:37.055852 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-0835a779-2fbc-4b22-b415-c034c8ed6e0a req-65844f93-fbb5-44b3-8997-20bcf83d4502 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426896 Nov 18 21:12:37.077979 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43770) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:37.121290 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23760e16-40ec-46d1-a5e6-15bde19c9582 tempest-TestVolumeBootPattern-1091376469 tempest-TestVolumeBootPattern-1091376469-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:37.122762 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-23760e16-40ec-46d1-a5e6-15bde19c9582 tempest-TestVolumeBootPattern-1091376469 tempest-TestVolumeBootPattern-1091376469-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1094 time: 0.0438213 Nov 18 21:12:37.126335 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43772) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:12:37.130564 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address': '172.20.0.11'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:12:37.152595 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:37.248944 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:37.357624 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Allocated IP 172.27.3.200 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/651883e6-dfef-4764-8bec-74c2f45c37a2) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:12:37.457660 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:37.491964 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:37.493396 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:37.537405 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:12:37.540354 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:12:37.543692 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:12:37.565604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=651883e6-dfef-4764-8bec-74c2f45c37a2,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:37.902518 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:37.972991 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:38.124808 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:38.129292 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:38.194278 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=651883e6-dfef-4764-8bec-74c2f45c37a2,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:12:38.207741 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:38.251259 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:38.311714 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.l3_db [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Floating IP 0f861e62-8650-4c07-a7bd-9ba50c0ce97f associated. External IP: 172.27.3.200, port: eb59c5f9-17de-415f-9154-1ff6f5903ba6. Nov 18 21:12:38.523123 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:12:38.633555 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:12:38.644084 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:12:38.651543 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:38.654474 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:12:38.655945 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:12:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:38.678800 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-d02c8139-8993-459a-a60f-9526ee039454 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.5514398 Nov 18 21:12:38.679637 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:12:38.682353 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c" -d '{"events": [{"name": "network-changed", "server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:12:38.764593 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:12:38.777441 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:12:38 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-26febfe1-1592-4224-97f4-49c28c2060ce x-openstack-request-id: req-26febfe1-1592-4224-97f4-49c28c2060ce {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:12:38.777739 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:12:38.777998 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-26febfe1-1592-4224-97f4-49c28c2060ce {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:12:38.778408 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'status': 'completed', 'code': 200} Nov 18 21:12:38.846571 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-6c087fdd-0a36-48d0-b5da-490e1002b6c0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:38.848097 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-6c087fdd-0a36-48d0-b5da-490e1002b6c0 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1099 time: 0.0429211 Nov 18 21:12:38.946629 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-cfac4e5a-b8bf-435d-a80a-206a16a65497 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:38.948130 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-cfac4e5a-b8bf-435d-a80a-206a16a65497 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0913832 Nov 18 21:12:39.001337 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:37Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:39.015655 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-cef2c615-f809-4500-ab20-bd4f8d5386bd service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 1000 time: 0.0591452 Nov 18 21:12:39.028342 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:12:39.037126 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:12:39.037732 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:12:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:39.068649 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-b6ce91d7-2f75-415c-b361-ec55aee3b9d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:39.070126 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-b6ce91d7-2f75-415c-b361-ec55aee3b9d8 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0473835 Nov 18 21:12:39.116410 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-670675a8-7424-4690-a7cb-b8203087bac0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:39.117942 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-670675a8-7424-4690-a7cb-b8203087bac0 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0400949 Nov 18 21:12:39.147037 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:12:39.208379 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-ab9e87df-db28-4a85-8d7c-3e6a808ee90b service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0816824 Nov 18 21:12:39.303493 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-4b60932f-6a96-4cc1-8f10-5f7ddcd2c48c req-dc8a8ec2-ca54-40c8-909c-3b9be72ff319 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0868742 Nov 18 21:12:39.377986 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:37Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:12:39.406781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798c3d61-51ed-413a-895d-50df6c91c5e3 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'DOWN', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:37Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:12:39.598434 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-3bf2b191-8df5-4a5b-bbc1-ded5043e46e9 None None] New status for floating IP 0f861e62-8650-4c07-a7bd-9ba50c0ce97f: ACTIVE {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:12:49.377228 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:12:55.693182 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-90bfca3e-8e2f-4e4c-aca8-5f860e07e4eb service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0414431 Nov 18 21:12:55.783017 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45854004-f1b2-4160-a59d-a97a3531067a req-d7ba060c-dbde-43ee-914e-f517d44a8a28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:55.784542 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-d7ba060c-dbde-43ee-914e-f517d44a8a28 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1099 time: 0.0419390 Nov 18 21:12:55.895539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45854004-f1b2-4160-a59d-a97a3531067a req-544f5534-2e82-4665-b7bb-dd3d5cd43d7d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:55.897034 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-544f5534-2e82-4665-b7bb-dd3d5cd43d7d service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0902872 Nov 18 21:12:55.962916 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-234070e8-ff72-4fcb-9ade-5a1ff09901f4 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 1002 time: 0.0582061 Nov 18 21:12:56.019815 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45854004-f1b2-4160-a59d-a97a3531067a req-87fcf68d-e5f0-45d2-bdd2-6a18fa88dd4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:56.021332 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-87fcf68d-e5f0-45d2-bdd2-6a18fa88dd4c service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0507114 Nov 18 21:12:56.072641 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45854004-f1b2-4160-a59d-a97a3531067a req-80ee6a40-f6be-42b9-a418-9816b7bdb68c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:12:56.074128 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-80ee6a40-f6be-42b9-a418-9816b7bdb68c service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0450237 Nov 18 21:12:56.193757 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-cd54ecc6-7f22-4277-9209-4137c82892a4 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1090128 Nov 18 21:12:56.293856 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-45854004-f1b2-4160-a59d-a97a3531067a req-7030111e-2ed0-4bc9-b7d2-cca5ab6e67a6 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910969 Nov 18 21:13:02.221300 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6cdd5e7a-673e-48c6-92df-efe7de438118 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:04.653565 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ae8ee435-9191-4f50-8364-8fe157de5698 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:06.038467 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:07.492710 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:08.253799 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:11.798130 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:13:19.367654 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:32.227066 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-29ad54bb-7275-4516-b952-626e62c5f2c1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:34.648466 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-cf01fb1a-aee0-431c-913a-39423faf01c5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:36.042067 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:37.497136 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:38.256257 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:48.798069 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:13:49.387711 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:13:56.702680 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-ac76ef45-f706-4c5a-83fe-994b3840ef5b service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0414290 Nov 18 21:13:56.786577 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-28bc3087-7001-4e67-8c99-9b20ed16ed44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:13:56.788045 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-28bc3087-7001-4e67-8c99-9b20ed16ed44 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1099 time: 0.0397551 Nov 18 21:13:56.894556 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-9f8ebfd5-9d50-45fb-a52d-144f122f6184 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:13:56.895998 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-9f8ebfd5-9d50-45fb-a52d-144f122f6184 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0865600 Nov 18 21:13:56.971741 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-88270ae8-85a3-42e3-9d00-f42f9d2f5c15 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 1002 time: 0.0659773 Nov 18 21:13:57.025740 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-fcef8143-6c7e-4748-a2c2-62bf5abaa158 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:13:57.027277 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-fcef8143-6c7e-4748-a2c2-62bf5abaa158 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0480418 Nov 18 21:13:57.074051 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-3eaf3d7a-3650-474c-9f2d-d2180186cb3f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:13:57.075517 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-3eaf3d7a-3650-474c-9f2d-d2180186cb3f service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398610 Nov 18 21:13:57.163732 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-27737bae-a802-4641-97ef-199924728582 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0803602 Nov 18 21:13:57.257851 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-19dd6dd6-f3e5-43df-a32f-97ff3a2e0d58 req-b661280c-05dd-40fd-9612-46478370fadd service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0853777 Nov 18 21:14:02.218411 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ac5c58c8-d6b6-431b-b58d-c993021c1a30 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:04.650233 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-4b3188e4-9587-446f-83d6-e31fd895c313 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:06.046681 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:07.499238 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:08.262131 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:19.391093 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:25.737309 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-bcb6ff2b-fa5a-4b0d-aad8-4afe833b78b2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1633191489&fields=id&tenant_id=97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 267 time: 0.0469012 Nov 18 21:14:25.797369 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:14:25.846497 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-84940e3d-0ac3-4b6c-9632-56978f98c7ee tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:25.848241 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-84940e3d-0ac3-4b6c-9632-56978f98c7ee tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 812 time: 0.1041830 Nov 18 21:14:25.863391 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-ce4259d8-707e-4fda-af3b-08e2b9ab6a80 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/quotas/97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 375 time: 0.0094204 Nov 18 21:14:25.914854 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-08356a1c-01b5-472f-a0c1-29661ec03073 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0462747 Nov 18 21:14:26.127202 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-389c9c87-ce69-4c46-9085-7b486faee2dc service neutron] 10.222.0.61 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1999214 Nov 18 21:14:26.216545 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-3daadd7b-6637-4c0c-be00-fef99f114ca1 service neutron] 10.222.0.61 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832639 Nov 18 21:14:26.496940 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c21f9b68-369c-4b92-a04a-0be45449f772 req-f4bd4aad-4255-4bec-b709-c5b9ea2a888a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 210 time: 0.0278146 Nov 18 21:14:27.419416 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-19eca45d-417f-4c69-9a1c-701cc1347702 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:27.420873 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-19eca45d-417f-4c69-9a1c-701cc1347702 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 812 time: 0.1085193 Nov 18 21:14:27.507768 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-f282ef09-cd6b-43d7-9352-6fb5e171a95a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=97c605960c964eb3960a3f3324bf46bb HTTP/1.1" status: 200 len: 380 time: 0.0580130 Nov 18 21:14:27.517956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'port': {'device_id': '6684cba8-a437-459c-8f9b-32b386a32e33', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'admin_state_up': True, 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'security_groups': ['05581fc3-f5ff-492a-8f7f-0d168cec3421']}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:14:27.592297 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-f77ea0ec-f28e-4fe0-8dbf-de885f3d77a9 req-6b471f3e-51a6-4d90-b06a-b062f2091989 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 210 time: 0.0275543 Nov 18 21:14:27.634602 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Made reservation on behalf of 97c605960c964eb3960a3f3324bf46bb for: {'port': 1} {{(pid=102669) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 18 21:14:27.638271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:27.773197 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_common [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Allocated IP 172.20.0.13 (e9895462-5764-4a81-a2a3-f5482f05a6a3/a8ffc170-cfa2-4b16-935a-923d6b39dd63/5be6a3c6-2b73-4f4e-986f-a78dec18a168) {{(pid=102669) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:14:27.925143 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:27.958752 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_create {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.004561 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 is already hosted by enough agents. {{(pid=102669) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:14:28.007631 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.base_scheduler [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Resources bound (agent type, host, resource id): {{(pid=102669) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:14:28.012820 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Received port after_create {{(pid=102669) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:14:28.038435 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=5be6a3c6-2b73-4f4e-986f-a78dec18a168,revision_number=1']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:28.051839 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.052239 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.052590 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.053134 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.053464 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.053795 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.054116 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.054439 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.054763 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.055083 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.055402 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.055729 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:28.080905 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:28.081435 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.100280 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-81c81a5d-4fc6-410c-a81c-d10763ad9e18 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.5862639 Nov 18 21:14:28.115056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.v2.base [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Request body: {'port': {'device_id': '6684cba8-a437-459c-8f9b-32b386a32e33', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-79987'}} {{(pid=102669) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:14:28.174146 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.224031 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-0940d4e5-384b-4668-8c46-fc170447f14f None None] Provisioning complete for port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 triggered by entity DHCP. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:14:28.224788 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-0940d4e5-384b-4668-8c46-fc170447f14f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.257910 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-0940d4e5-384b-4668-8c46-fc170447f14f None None] Port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 cannot update to ACTIVE because it is not bound. {{(pid=102671) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:342}} Nov 18 21:14:28.431263 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 5be6a3c6-2b73-4f4e-986f-a78dec18a168 {{(pid=102669) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:14:28.439162 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Publish callbacks [] for port, precommit_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.451218 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.provisioning_blocks [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Transition to ACTIVE for port object 5be6a3c6-2b73-4f4e-986f-a78dec18a168 will not be triggered until provisioned by entity L2. {{(pid=102669) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 18 21:14:28.455015 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.505813 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Pushing event updated for resources: {'Port': ['ID=5be6a3c6-2b73-4f4e-986f-a78dec18a168,revision_number=2']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:28.575872 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Attempting to bind port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 on host hv-cinder-79987 for vnic_type normal with profile {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 18 21:14:28.576593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Attempting to bind port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 by drivers openvswitch,hyperv on host hv-cinder-79987 at level 0 using segments [{'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 18 21:14:28.576593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Attempting to bind port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:14:28.582216 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-79987 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 18 21:14:28.582539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Attempting to bind port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 on network e9895462-5764-4a81-a2a3-f5482f05a6a3 {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 18 21:14:28.587544 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Checking agent: {'id': '638a4d5f-cfca-474f-85f3-c5c7be4a83aa', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-79987', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'started_at': datetime.datetime(2021, 11, 18, 20, 58, 49), 'heartbeat_timestamp': datetime.datetime(2021, 11, 18, 21, 14, 19), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 18 21:14:28.587883 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Checking segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=102669) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 18 21:14:28.588300 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Bound using segment: {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'} {{(pid=102669) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 18 21:14:28.588847 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.managers [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Bound port: 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host: hv-cinder-79987, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'd8703035-b9e3-4e75-be30-8ad0a395f302', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 639, 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3'}}] {{(pid=102669) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 18 21:14:28.589394 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.658402 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] For port 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host hv-cinder-79987, cleared binding levels {{(pid=102669) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 18 21:14:28.661916 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] For port 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host hv-cinder-79987, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102669) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 18 21:14:28.667349 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5320327'] for port, after_update {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.683331 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:28.684222 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:28.685643 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] 10.222.0.62 "PUT /v2.0/ports/5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 200 len: 1094 time: 0.5754282 Nov 18 21:14:28.689131 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:14:28.692291 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-af5524c8-cda8-4b61-be40-12324a2cf402" -d '{"events": [{"name": "network-changed", "server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:14:28.763765 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:14:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9486afad-ff65-418f-ad26-9737bf92b8fe x-openstack-request-id: req-9486afad-ff65-418f-ad26-9737bf92b8fe {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:14:28.764680 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:14:28.764978 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-9486afad-ff65-418f-ad26-9737bf92b8fe {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:14:28.765422 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'status': 'completed', 'code': 200} Nov 18 21:14:28.823341 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-22ff5de7-8d8a-4666-9c4a-995b43967db6 service neutron] Pushing event updated for resources: {'Port': ['ID=5be6a3c6-2b73-4f4e-986f-a78dec18a168,revision_number=3']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:28.836007 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05073f04-74c5-476a-bfac-345f48e9159b req-7c77427b-441d-471c-8b47-5cefd082838c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:28.837570 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-05073f04-74c5-476a-bfac-345f48e9159b req-7c77427b-441d-471c-8b47-5cefd082838c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.1498470 Nov 18 21:14:28.844647 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-be8888f1-17ad-4a7d-b9e4-029090995fac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:28.846108 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-be8888f1-17ad-4a7d-b9e4-029090995fac service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1097 time: 0.0936337 Nov 18 21:14:28.905177 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-49ea6ec2-e2a4-4b3d-aef5-fe3527d38d1d service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 200 len: 217 time: 0.0432332 Nov 18 21:14:28.955969 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-05073f04-74c5-476a-bfac-345f48e9159b req-80fc27d4-c5b9-4b36-8629-b17cf10fd0c1 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1088161 Nov 18 21:14:28.970388 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-4bbee953-f2b7-437d-b51e-25b2730111af service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:28.971830 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-4bbee953-f2b7-437d-b51e-25b2730111af service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0587640 Nov 18 21:14:29.018603 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-722de2f4-ac85-454d-93fa-ee83f968569a req-96653f30-71ac-474d-9fae-a82ff4d286b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:29.020060 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-96653f30-71ac-474d-9fae-a82ff4d286b6 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0396872 Nov 18 21:14:29.113054 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-841ffe1c-36e9-4ba8-ab81-e6a98d8ab2ad service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0848763 Nov 18 21:14:29.202492 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-722de2f4-ac85-454d-93fa-ee83f968569a req-32d1b792-ca62-4b93-9dd4-50e12d75312c service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0812237 Nov 18 21:14:29.302265 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-bfa3db8f-11d4-4a7f-b9d1-ebb49badd1ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:29.303658 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-bfa3db8f-11d4-4a7f-b9d1-ebb49badd1ac service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1097 time: 0.0423441 Nov 18 21:14:29.400859 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-8e31ec78-7eb2-4b00-8840-7d4850e46a9d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:29.403091 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-8e31ec78-7eb2-4b00-8840-7d4850e46a9d service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0914791 Nov 18 21:14:29.446679 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-f553b578-1c8e-4737-9e88-5da6bc5e791a service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 200 len: 217 time: 0.0360281 Nov 18 21:14:29.502051 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-29957137-960d-4202-8a2e-5d8b2847529e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:29.503503 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-29957137-960d-4202-8a2e-5d8b2847529e service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0494313 Nov 18 21:14:29.556467 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-fc1cbfe4-08de-4421-a00e-3788ae966ef2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:29.558040 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-fc1cbfe4-08de-4421-a00e-3788ae966ef2 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0453713 Nov 18 21:14:29.655791 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-c647c22a-90b2-45ff-a02c-585277cc89c5 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0860765 Nov 18 21:14:29.759391 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-af5524c8-cda8-4b61-be40-12324a2cf402 req-d3014829-a081-4d27-a605-562de59f473a service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924194 Nov 18 21:14:30.071704 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-371e45c7-6323-402b-a5ba-a50706f36faf req-6fc94347-7898-4950-a8f3-7d9b8d317700 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:30.073916 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-371e45c7-6323-402b-a5ba-a50706f36faf req-6fc94347-7898-4950-a8f3-7d9b8d317700 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0480201 Nov 18 21:14:30.126518 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-371e45c7-6323-402b-a5ba-a50706f36faf req-0b00a027-4269-413c-81e4-31adef2af03c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461333 Nov 18 21:14:31.248986 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e903094e-acca-4e22-a330-fdac3a883540 req-6091166a-9a0e-4a2c-8ab2-38050b7a42f3 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:31.250440 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e903094e-acca-4e22-a330-fdac3a883540 req-6091166a-9a0e-4a2c-8ab2-38050b7a42f3 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0554421 Nov 18 21:14:31.299064 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e903094e-acca-4e22-a330-fdac3a883540 req-fe96d7cb-26f3-4454-a6a1-51c9d203b00c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0426881 Nov 18 21:14:32.220209 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c928d56a-7de8-4a90-b6ad-12e5c2472a2d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:32.413933 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d561bdff-a1ff-48a8-84b6-7f40a718a5e9 req-c4d23a37-1afe-493f-8df9-967586409f8e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:32.415407 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d561bdff-a1ff-48a8-84b6-7f40a718a5e9 req-c4d23a37-1afe-493f-8df9-967586409f8e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0488999 Nov 18 21:14:32.465013 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d561bdff-a1ff-48a8-84b6-7f40a718a5e9 req-6e9d8d51-8e04-40e2-97a3-baf0c444766e tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435541 Nov 18 21:14:33.583121 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-391280f0-a9f7-4d89-9773-cb67c2c3211c req-412dce80-24f5-47fe-a725-4641a9ba6555 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:33.584628 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-391280f0-a9f7-4d89-9773-cb67c2c3211c req-412dce80-24f5-47fe-a725-4641a9ba6555 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0541971 Nov 18 21:14:33.634525 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-391280f0-a9f7-4d89-9773-cb67c2c3211c req-b55f9a3c-671e-49ac-9e70-326b4b894189 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428216 Nov 18 21:14:34.654246 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-123a13ab-97bd-420d-b323-27717871fdb6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:34.756300 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de6cd968-f82b-4f7b-ad0a-1fcc6a197976 req-c697d0ef-fe49-429a-ac59-e5ea7a2ef6b2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:34.757769 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-de6cd968-f82b-4f7b-ad0a-1fcc6a197976 req-c697d0ef-fe49-429a-ac59-e5ea7a2ef6b2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0493634 Nov 18 21:14:34.809236 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-de6cd968-f82b-4f7b-ad0a-1fcc6a197976 req-759250eb-2427-494a-b7a3-716fa6c9c8eb tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454402 Nov 18 21:14:35.933300 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bdd90440-99e0-4c03-a268-3a2e7def3e10 req-e3a527c3-c9c1-491d-bda5-ebac5f7c1cf5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:35.934939 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bdd90440-99e0-4c03-a268-3a2e7def3e10 req-e3a527c3-c9c1-491d-bda5-ebac5f7c1cf5 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0513995 Nov 18 21:14:35.984946 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-bdd90440-99e0-4c03-a268-3a2e7def3e10 req-1e15a0a8-00ac-4357-ab54-43c5a3d54cae tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437319 Nov 18 21:14:36.048596 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:37.119337 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d7f5e9ba-1a29-49fc-8c8b-77da6e09d032 req-24536e04-b3a7-47af-9611-472bcf90caea tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:37.120376 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d7f5e9ba-1a29-49fc-8c8b-77da6e09d032 req-24536e04-b3a7-47af-9611-472bcf90caea tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 944 time: 0.0560241 Nov 18 21:14:37.174329 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-d7f5e9ba-1a29-49fc-8c8b-77da6e09d032 req-80133e24-feac-463a-9213-556735260020 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466759 Nov 18 21:14:37.252585 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 5be6a3c6-2b73-4f4e-986f-a78dec18a168 details requested by agent hyperv_hv-cinder-79987 with host hv-cinder-79987 {{(pid=102671) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 18 21:14:37.365376 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:14:37.376931 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Returning: {'device': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'port_id': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'mac_address': 'fa:16:3e:46:91:0a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 639, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=102671) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 18 21:14:37.416404 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:37.429686 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 5be6a3c6-2b73-4f4e-986f-a78dec18a168 {{(pid=102671) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 18 21:14:37.451509 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:14:37.456495 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:37.520970 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=5be6a3c6-2b73-4f4e-986f-a78dec18a168,revision_number=4']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:37.524295 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:37.529978 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.530331 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.530701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.531038 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.531369 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.531699 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.532028 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.532382 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.532714 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.533035 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.533371 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.533686 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:37.700778 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] get_ports_and_sgs() called for port_ids ['5be6a3c6-2b73-4f4e-986f-a78dec18a168'] {{(pid=102671) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 18 21:14:38.268023 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:38.296512 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99d31e34-0785-4698-93a9-3f8fb28819c6 req-dc9f1946-a92b-4191-ac21-1e2730431c04 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:38.297947 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-99d31e34-0785-4698-93a9-3f8fb28819c6 req-dc9f1946-a92b-4191-ac21-1e2730431c04 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 945 time: 0.0528240 Nov 18 21:14:38.350078 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-99d31e34-0785-4698-93a9-3f8fb28819c6 req-a1e8a2dc-aa8f-4e14-9234-de1a1149efb7 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0462773 Nov 18 21:14:39.267636 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 5be6a3c6-2b73-4f4e-986f-a78dec18a168 up at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 18 21:14:39.319543 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning for port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 completed by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 18 21:14:39.323722 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.provisioning_blocks [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Provisioning complete for port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 triggered by entity L2. {{(pid=102671) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 18 21:14:39.324100 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-2092903'] for port, provisioning_complete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:39.400161 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:39.423523 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168'}] {{(pid=102671) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:14:39.425796 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}be4897ae3f5c8a79a6afec99ee6256e9ca04ae7b6233720cfb795973a31c0fc9" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-81295eab-6912-42cd-870b-06bfa3f98fa7" -d '{"events": [{"server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "name": "network-vif-plugged", "status": "completed", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168"}]}' {{(pid=102671) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:14:39.439043 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] For port 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:14:39.443338 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610'] for port, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:39.471368 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:14:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e66c4063-f2c1-42c8-9826-b8b9c4e401fe x-openstack-request-id: req-e66c4063-f2c1-42c8-9826-b8b9c4e401fe {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:14:39.471889 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "name": "network-vif-plugged", "status": "completed", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168", "code": 200}]} {{(pid=102671) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:14:39.471889 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-e66c4063-f2c1-42c8-9826-b8b9c4e401fe {{(pid=102671) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:14:39.472289 dv-cinder-799871-8-iscsi neutron-server[102671]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'code': 200} Nov 18 21:14:39.486471 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9affc26d-b5b9-4150-84ed-52dcf9e48874 req-1e182465-d675-42c4-b7b7-c0b5f9650a02 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:39.488026 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9affc26d-b5b9-4150-84ed-52dcf9e48874 req-1e182465-d675-42c4-b7b7-c0b5f9650a02 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 945 time: 0.0704188 Nov 18 21:14:39.501735 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Pushing event updated for resources: {'Port': ['ID=5be6a3c6-2b73-4f4e-986f-a78dec18a168,revision_number=5']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:39.544957 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-9affc26d-b5b9-4150-84ed-52dcf9e48874 req-5551273a-c9e6-46b8-a0d5-5488c1a949c4 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0490856 Nov 18 21:14:39.691282 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84d6895a-e641-42aa-9fba-c33809b70c40 req-ef8930e1-adc0-4fc2-afe1-8075f95bb3ef service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:39.692812 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-84d6895a-e641-42aa-9fba-c33809b70c40 req-ef8930e1-adc0-4fc2-afe1-8075f95bb3ef service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1099 time: 0.0433285 Nov 18 21:14:39.742524 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-84d6895a-e641-42aa-9fba-c33809b70c40 req-8fb349a1-1425-452c-b55e-4387652b6ef4 service neutron] 10.222.0.62 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0410419 Nov 18 21:14:40.669472 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-569d6b00-afa6-441e-8c41-0f489c299995 req-89aaeffe-47f1-4df4-9f0f-026fef6c09ea tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:40.672079 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-569d6b00-afa6-441e-8c41-0f489c299995 req-89aaeffe-47f1-4df4-9f0f-026fef6c09ea tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 946 time: 0.0551136 Nov 18 21:14:40.746539 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-569d6b00-afa6-441e-8c41-0f489c299995 req-cd16df22-8821-4858-8cb5-3f8273d48dc2 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0656366 Nov 18 21:14:41.868374 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-818b2f4b-6f66-404f-b085-5db369c4555d req-4fc1947a-dfd6-4f24-80b2-804c78570371 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:41.869840 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-818b2f4b-6f66-404f-b085-5db369c4555d req-4fc1947a-dfd6-4f24-80b2-804c78570371 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 946 time: 0.0535376 Nov 18 21:14:41.919655 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-818b2f4b-6f66-404f-b085-5db369c4555d req-e8a54e35-607b-4934-b0cf-dc1e4865e8e0 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431271 Nov 18 21:14:42.036984 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5d916da-be8b-4b03-8415-b7e1369b04da req-6dc929a8-2f03-458e-ae87-6a04a966aa03 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:42.038434 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a5d916da-be8b-4b03-8415-b7e1369b04da req-6dc929a8-2f03-458e-ae87-6a04a966aa03 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 946 time: 0.0524611 Nov 18 21:14:42.086725 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-a5d916da-be8b-4b03-8415-b7e1369b04da req-69d6b911-e8ee-475f-bc52-72fba4f3a8c6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423777 Nov 18 21:14:42.109443 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43902) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:14:42.148207 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ffc16294-1d7f-4ac3-a746-0616b160786a tempest-TestVolumeBootPattern-1091376469 tempest-TestVolumeBootPattern-1091376469-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:42.149683 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-ffc16294-1d7f-4ac3-a746-0616b160786a tempest-TestVolumeBootPattern-1091376469 tempest-TestVolumeBootPattern-1091376469-project-admin] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1094 time: 0.0392904 Nov 18 21:14:42.152558 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43904) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:14:42.156830 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.v2.base [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Request body: {'floatingip': {'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'port_id': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address': '172.20.0.13'}} {{(pid=102670) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 18 21:14:42.177684 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:42.276966 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:42.378933 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_common [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Allocated IP 172.27.3.125 (3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2/3a94b01e-338e-4379-8e3f-ecc667769e62/b77aa637-45e4-4488-9a46-e2c3908e4a65) {{(pid=102670) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 18 21:14:42.480169 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:42.514405 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8748164977574', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:42.553113 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Network 3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2 is already hosted by enough agents. {{(pid=102670) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 18 21:14:42.555910 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.base_scheduler [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Resources bound (agent type, host, resource id): {{(pid=102670) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 18 21:14:42.559486 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Received port after_create {{(pid=102670) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 18 21:14:42.583216 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=b77aa637-45e4-4488-9a46-e2c3908e4a65,revision_number=1']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:42.594314 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.594663 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.595004 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.595340 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.595669 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.596000 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.596355 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.596684 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.597006 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.597329 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.597903 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:42.598221 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:14:43.173267 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:43.236342 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-1678327'] for port, before_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:43.383258 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for port, precommit_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:43.387576 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8748165435091', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8748164977592', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8748164977610', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-5839901'] for port, after_update {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:43.460706 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event updated for resources: {'Port': ['ID=b77aa637-45e4-4488-9a46-e2c3908e4a65,revision_number=2']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:14:43.467554 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1014026'] for floatingip, after_create {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:43.568007 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.db.l3_db [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Floating IP d82c3f25-f8cf-4a30-8840-a95c18e6b7f3 associated. External IP: 172.27.3.125, port: 5be6a3c6-2b73-4f4e-986f-a78dec18a168. Nov 18 21:14:43.779611 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:14:43.888338 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:14:43.897940 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:14:43.907102 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:43.908243 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:14:43.908860 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:14:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:14:43.934442 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a5c799ac-03a9-4cec-96be-10f9359218bd tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 1.7808671 Nov 18 21:14:43.935033 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168'}] {{(pid=102670) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:14:43.938119 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}4e9dcf79326564b02ed23a5ef2462436e5a330ffb804204739a214c58ddf1741" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79a97a9f-3644-422b-b14f-9b73a4b72a85" -d '{"events": [{"name": "network-changed", "server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168"}]}' {{(pid=102670) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:14:43.979654 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:14:43 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-52b3682a-bb35-4b0e-a26e-c2cab45aacce x-openstack-request-id: req-52b3682a-bb35-4b0e-a26e-c2cab45aacce {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:14:43.979947 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168", "status": "completed", "code": 200}]} {{(pid=102670) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:14:43.980230 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-52b3682a-bb35-4b0e-a26e-c2cab45aacce {{(pid=102670) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:14:43.980638 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'status': 'completed', 'code': 200} Nov 18 21:14:44.055380 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-ad96b6b9-d185-42d3-904f-510e7ee86890 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:44.056960 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-ad96b6b9-d185-42d3-904f-510e7ee86890 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1099 time: 0.0438447 Nov 18 21:14:44.150351 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:14:44.394801 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:39Z', 'revision_number': 1, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}, {'id': 'd82c3f25-f8cf-4a30-8840-a95c18e6b7f3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.125', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:46:91:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6684cba8-a437-459c-8f9b-32b386a32e33', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:14:42Z', 'updated_at': '2021-11-18T21:14:42Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:14:44.427505 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:14:44.436385 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:14:44.437007 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:14:35Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:14:44.444743 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-8afa3555-1bc5-4aa3-8007-df0816da8f52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:44.446237 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-8afa3555-1bc5-4aa3-8007-df0816da8f52 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.3797762 Nov 18 21:14:44.513063 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-fea80d4a-b06d-4019-b71c-078de0ddd618 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 200 len: 1000 time: 0.0588591 Nov 18 21:14:44.545931 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:14:44.564532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-37a1eb9a-8548-4152-bbda-41a47c828c6f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:44.565973 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-37a1eb9a-8548-4152-bbda-41a47c828c6f service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0438540 Nov 18 21:14:44.616973 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-f99527aa-032e-4f06-9f65-149f3a90a0d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:44.618452 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-f99527aa-032e-4f06-9f65-149f3a90a0d7 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0452867 Nov 18 21:14:44.714580 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-1811ceb2-d226-426f-86d1-b70452179dc9 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0874269 Nov 18 21:14:44.781317 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:39Z', 'revision_number': 1, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}, {'id': 'd82c3f25-f8cf-4a30-8840-a95c18e6b7f3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.125', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:46:91:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6684cba8-a437-459c-8f9b-32b386a32e33', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:14:42Z', 'updated_at': '2021-11-18T21:14:42Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:14:44.813427 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7e6f386f-0ae7-4517-b360-9923afdf82d2 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:39Z', 'revision_number': 1, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}, {'id': 'd82c3f25-f8cf-4a30-8840-a95c18e6b7f3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.125', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 702, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:46:91:0a', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '6684cba8-a437-459c-8f9b-32b386a32e33', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:14:42Z', 'updated_at': '2021-11-18T21:14:42Z', 'revision_number': 0, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:14:44.815794 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-79a97a9f-3644-422b-b14f-9b73a4b72a85 req-e7bbfdb4-bd27-4a40-9fb7-0f1be013cfff service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0924988 Nov 18 21:14:45.013666 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b8d6c47d-ba81-4506-a1b4-46d5fe16bd53 None None] New status for floating IP d82c3f25-f8cf-4a30-8840-a95c18e6b7f3: ACTIVE {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:14:49.408280 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:14:56.683840 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-3719e03b-f397-460e-8c9a-afce306e446a service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0406780 Nov 18 21:14:56.784170 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663d474-ffb1-4131-8037-691fce657e0a req-4ed3674d-5f41-4242-86dd-327daed2b1a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:56.787606 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-4ed3674d-5f41-4242-86dd-327daed2b1a9 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1099 time: 0.0474911 Nov 18 21:14:56.915514 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663d474-ffb1-4131-8037-691fce657e0a req-c793be57-11e8-4295-b1b2-b02246bf993b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:56.917207 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-c793be57-11e8-4295-b1b2-b02246bf993b service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0883555 Nov 18 21:14:56.987014 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-576aa546-dc25-4913-aef4-b0866ca355a5 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 1002 time: 0.0617414 Nov 18 21:14:57.040274 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663d474-ffb1-4131-8037-691fce657e0a req-811492c3-030c-4ccd-ab97-74e5febc5e99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:57.041731 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-811492c3-030c-4ccd-ab97-74e5febc5e99 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0474834 Nov 18 21:14:57.094114 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3663d474-ffb1-4131-8037-691fce657e0a req-dbdb1837-785d-43a1-a3dd-8f29b6b336ea service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:14:57.095602 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-dbdb1837-785d-43a1-a3dd-8f29b6b336ea service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0459383 Nov 18 21:14:57.187080 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-97b3fb7f-dbd8-4092-96f7-c2e3697ba7ef service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0835319 Nov 18 21:14:57.283840 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-3663d474-ffb1-4131-8037-691fce657e0a req-804d7526-ee6f-4047-88e9-ee95dba88452 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0890906 Nov 18 21:15:02.222048 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-13b38fed-288e-4ce7-a1d5-c1c092ad428b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:02.796996 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:15:04.658784 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-4d9e7f19-6c00-4d62-9066-c8df8dddaaac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:06.050069 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:07.506789 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:08.260198 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:19.406334 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:32.224973 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-769e321d-6b37-419f-9306-5ed6ed2d11ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:34.659971 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-c4da92cf-8475-4763-b78e-1c4e9fef947b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:36.051801 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:37.508357 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:38.262334 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:39.795055 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:15:49.402812 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:15:56.734075 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-83da4f7c-8613-455d-a4e9-9a1d9a402e2e service neutron] 10.222.0.62 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0870790 Nov 18 21:15:56.795870 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04729387-4873-4203-8930-54f4e3d741a4 req-ca052e20-f9b8-4bf9-b5b7-b6bbe3971483 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:15:56.798064 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-ca052e20-f9b8-4bf9-b5b7-b6bbe3971483 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1099 time: 0.0410540 Nov 18 21:15:56.913259 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04729387-4873-4203-8930-54f4e3d741a4 req-65757aaa-a3e3-4759-b497-59708135a4fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:15:56.914678 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-65757aaa-a3e3-4759-b497-59708135a4fd service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.0934529 Nov 18 21:15:56.982350 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-73f4bc48-2817-4eeb-b6e3-68aec6f4fad3 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 200 len: 1002 time: 0.0602453 Nov 18 21:15:57.036395 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04729387-4873-4203-8930-54f4e3d741a4 req-bf8dac79-72e6-4fbd-b54f-e9fecdf4223f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:15:57.037863 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-bf8dac79-72e6-4fbd-b54f-e9fecdf4223f service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0483172 Nov 18 21:15:57.092771 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04729387-4873-4203-8930-54f4e3d741a4 req-aab3c1e3-be30-48ac-a34e-7b68fca4777e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:15:57.094345 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-aab3c1e3-be30-48ac-a34e-7b68fca4777e service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477664 Nov 18 21:15:57.187210 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-53ab956b-dbd9-4c35-bae3-dd81d203095a service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0839412 Nov 18 21:15:57.279878 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-04729387-4873-4203-8930-54f4e3d741a4 req-8af70682-cb4d-4d98-8e43-a957e19eeee5 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0856142 Nov 18 21:16:02.226544 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-76696fd7-6e90-4a95-ba32-b57090980a0c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:04.661206 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-3b5b56e4-b7d1-44c4-9b0b-4bca76d7531b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:06.055255 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:07.511584 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:07.911612 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-88b6a269-3810-4d22-84fe-cda93eb341e0 req-6a2fb8fa-985e-4620-8be2-ae9d9cb11b28 service neutron] (102670) timed out ('10.222.0.62', 59524) {{(pid=102670) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 18 21:16:08.060799 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [req-a1869d8f-c246-4ff1-929b-1deab024b0ba req-2cbaaf31-9d99-4458-8c56-a17187b28ab1 service neutron] (102669) timed out ('10.222.0.62', 59529) {{(pid=102669) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 18 21:16:08.264546 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:12.242754 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43934) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:12.402183 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Deleting port b77aa637-45e4-4488-9a46-e2c3908e4a65 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:12.402508 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:12.476080 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:12.476434 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:12.489142 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Calling delete_port for b77aa637-45e4-4488-9a46-e2c3908e4a65 owned by network:floatingip {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:12.637327 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:12.661871 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'Port': ['ID=b77aa637-45e4-4488-9a46-e2c3908e4a65,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:12.691259 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.691609 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.691948 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.692306 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.692637 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.692967 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.693295 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.693619 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.693942 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.694261 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.694580 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.694899 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102669) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:12.733247 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:12.733714 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Floating IP d82c3f25-f8cf-4a30-8840-a95c18e6b7f3 disassociated (deleted). External IP: 172.27.3.125, port: 5be6a3c6-2b73-4f4e-986f-a78dec18a168. Nov 18 21:16:12.944892 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:16:13.053186 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:16:13.058671 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:13.066559 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:16:13.078198 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:13.078826 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:13.086823 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-4a4de502-e78c-4343-a660-26f3aca93f38 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "DELETE /v2.0/floatingips/d82c3f25-f8cf-4a30-8840-a95c18e6b7f3 HTTP/1.1" status: 204 len: 168 time: 0.8427651 Nov 18 21:16:13.087394 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:16:13.089701 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7b011af4-6668-4efa-b9aa-f27eef760c97" -d '{"events": [{"name": "network-changed", "server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:16:13.131555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:16:13 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3302d1a6-3f6f-4d98-9459-62709701ccf7 x-openstack-request-id: req-3302d1a6-3f6f-4d98-9459-62709701ccf7 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:16:13.131555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:16:13.131555 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-3302d1a6-3f6f-4d98-9459-62709701ccf7 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:16:13.131900 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'status': 'completed', 'code': 200} Nov 18 21:16:13.198297 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:13.202935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-b5e28014-fa84-479e-892f-31d0adf02548 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:13.205308 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-b5e28014-fa84-479e-892f-31d0adf02548 service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 1099 time: 0.0495040 Nov 18 21:16:13.328233 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-9500628a-dfea-4dc8-82cc-d8e97620f739 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:13.329848 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-9500628a-dfea-4dc8-82cc-d8e97620f739 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.1074545 Nov 18 21:16:13.382619 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-51be9081-e211-4d31-8efe-cb2ffe92f060 service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 200 len: 217 time: 0.0434279 Nov 18 21:16:13.437769 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-b621ce2e-02a1-4c71-99cd-902d671ca8cc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:13.443667 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-b621ce2e-02a1-4c71-99cd-902d671ca8cc service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0484552 Nov 18 21:16:13.445176 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4b5af91-4806-4900-a35b-30faacbed48c req-8bd58a24-6eb4-4a5b-b56d-869644a94ade tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:13.446844 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c4b5af91-4806-4900-a35b-30faacbed48c req-8bd58a24-6eb4-4a5b-b56d-869644a94ade tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 946 time: 0.1565051 Nov 18 21:16:13.451564 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:39Z', 'revision_number': 1, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:13.482509 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:16:13.492040 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-bd361609-d8df-4442-b803-922cdb628ac1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:13.493769 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-bd361609-d8df-4442-b803-922cdb628ac1 service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0444541 Nov 18 21:16:13.494969 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:13.495627 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:13.511465 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-c4b5af91-4806-4900-a35b-30faacbed48c req-2143f803-405f-4c70-92ff-3337089a56e3 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0571103 Nov 18 21:16:13.602844 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-4107f914-761f-4101-bf2e-bc09b987cb89 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1000478 Nov 18 21:16:13.607993 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:13.697824 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-7b011af4-6668-4efa-b9aa-f27eef760c97 req-fc0b50cc-79a4-497e-8456-37c25c8a3bd1 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0874283 Nov 18 21:16:13.852520 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:39Z', 'revision_number': 1, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:13.883014 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-aba4000e-e8f0-4b0f-aa23-baaffd99150c None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_floatingips': [{'id': '0f861e62-8650-4c07-a7bd-9ba50c0ce97f', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'floating_ip_address': '172.27.3.200', 'floating_network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'router_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'port_id': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'fixed_ip_address': '172.20.0.11', 'status': 'ACTIVE', 'standard_attr_id': 699, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'mac_address': 'fa:16:3e:0b:cf:22', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-18T21:12:37Z', 'updated_at': '2021-11-18T21:12:39Z', 'revision_number': 1, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:16:14.106432 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d9d0ed94-459c-4f23-b03b-c5152056c7b5 None None] New status for floating IP d82c3f25-f8cf-4a30-8840-a95c18e6b7f3: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:16:14.693958 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c05c9aac-9c90-475f-8f4a-b1963ecf8435 req-f4585d77-5340-4ce7-a4ad-85a51be49243 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:14.695502 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c05c9aac-9c90-475f-8f4a-b1963ecf8435 req-f4585d77-5340-4ce7-a4ad-85a51be49243 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 946 time: 0.1041956 Nov 18 21:16:14.754976 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-c05c9aac-9c90-475f-8f4a-b1963ecf8435 req-5bc7d79a-5298-4f03-b9ea-1aecc30309ac tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533545 Nov 18 21:16:14.978416 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-cfe7e359-ceb2-496a-b5a3-6b0df70a5bcc tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:14.979890 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-cfe7e359-ceb2-496a-b5a3-6b0df70a5bcc tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 946 time: 0.0477412 Nov 18 21:16:15.070786 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Deleting port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:15.071118 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:15.166144 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] For port 5be6a3c6-2b73-4f4e-986f-a78dec18a168, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=5be6a3c6-2b73-4f4e-986f-a78dec18a168,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:15.166422 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:15.180217 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Calling delete_port for 5be6a3c6-2b73-4f4e-986f-a78dec18a168 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:15.311930 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:15.339838 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'Port': ['ID=5be6a3c6-2b73-4f4e-986f-a78dec18a168,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:15.382749 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] No DVR routers for this DVR port 5be6a3c6-2b73-4f4e-986f-a78dec18a168 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:16:15.385183 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:15.388486 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-439024d9-d759-46fe-8695-bc1db80a4d0a req-6d0ccd73-593f-41c7-a375-e271cafaf25b tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "DELETE /v2.0/ports/5be6a3c6-2b73-4f4e-986f-a78dec18a168 HTTP/1.1" status: 204 len: 173 time: 0.4021680 Nov 18 21:16:15.388974 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'name': 'network-vif-deleted', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:16:15.391203 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0a9a2688-1e67-4525-a53a-fa3c380ebaf3" -d '{"events": [{"server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "name": "network-vif-deleted", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:16:15.429637 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:16:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-041ad755-6300-499e-b875-15db5957b902 x-openstack-request-id: req-041ad755-6300-499e-b875-15db5957b902 {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:16:15.429935 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "6684cba8-a437-459c-8f9b-32b386a32e33", "name": "network-vif-deleted", "tag": "5be6a3c6-2b73-4f4e-986f-a78dec18a168", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:16:15.430190 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-041ad755-6300-499e-b875-15db5957b902 {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:16:15.430595 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '6684cba8-a437-459c-8f9b-32b386a32e33', 'name': 'network-vif-deleted', 'tag': '5be6a3c6-2b73-4f4e-986f-a78dec18a168', 'status': 'completed', 'code': 200} Nov 18 21:16:15.874384 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-dca2134b-d722-4b9a-90da-6c1e42218ce9 req-406d3da9-d35a-427f-8c9b-9bc807a2c832 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=6684cba8-a437-459c-8f9b-32b386a32e33 HTTP/1.1" status: 200 len: 210 time: 0.0308228 Nov 18 21:16:16.794599 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:16:17.733181 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 5be6a3c6-2b73-4f4e-986f-a78dec18a168 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:17.757595 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: 5be6a3c6-2b73-4f4e-986f-a78dec18a168 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:17.757944 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device 5be6a3c6-2b73-4f4e-986f-a78dec18a168 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:19.153057 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 43978) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:19.308213 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Deleting port 651883e6-dfef-4764-8bec-74c2f45c37a2 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:19.308554 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.382501 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.382824 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.394564 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Calling delete_port for 651883e6-dfef-4764-8bec-74c2f45c37a2 owned by network:floatingip {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:19.421035 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.543068 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.570347 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'Port': ['ID=651883e6-dfef-4764-8bec-74c2f45c37a2,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:19.633705 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.634031 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.db.l3_db [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Floating IP 0f861e62-8650-4c07-a7bd-9ba50c0ce97f disassociated (deleted). External IP: 172.27.3.200, port: eb59c5f9-17de-415f-9154-1ff6f5903ba6. Nov 18 21:16:19.841802 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:16:19.948271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:16:19.953129 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:19.958299 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:16:19.967838 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:19.968509 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:20.213858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:20.265320 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-7dfe4520-7495-4e47-80b0-466448d10310 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "DELETE /v2.0/floatingips/0f861e62-8650-4c07-a7bd-9ba50c0ce97f HTTP/1.1" status: 204 len: 168 time: 1.1111033 Nov 18 21:16:20.265962 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:16:20.268450 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-16ddbaf7-017f-4bf9-8244-ac28fac869ce" -d '{"events": [{"name": "network-changed", "server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:16:20.311837 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Thu, 18 Nov 2021 21:16:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-82df5161-8270-4dd5-a1a1-04cac11cc16d x-openstack-request-id: req-82df5161-8270-4dd5-a1a1-04cac11cc16d {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:16:20.312160 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:16:20.312612 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-82df5161-8270-4dd5-a1a1-04cac11cc16d {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:16:20.313133 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'status': 'completed', 'code': 200} Nov 18 21:16:20.377634 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-5da90c82-036f-4cd2-a426-c4674a8462fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:20.380148 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-5da90c82-036f-4cd2-a426-c4674a8462fa service neutron] 10.222.0.62 "GET /v2.0/ports?tenant_id=97c605960c964eb3960a3f3324bf46bb&device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 1099 time: 0.0423532 Nov 18 21:16:20.439650 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:20.475224 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:16:20.485366 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:20.486380 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:20.493360 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-01ff8e2c-420f-43a7-aeef-ce61097127c8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:20.495099 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-01ff8e2c-420f-43a7-aeef-ce61097127c8 service neutron] 10.222.0.62 "GET /v2.0/networks?id=e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 200 len: 913 time: 0.1038878 Nov 18 21:16:20.511270 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-723611ac-fb45-4939-8c2f-966c737d9ab0 req-df1f7e5b-5b1a-462c-9a3c-c4033e75daac tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102670) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:20.513519 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-723611ac-fb45-4939-8c2f-966c737d9ab0 req-df1f7e5b-5b1a-462c-9a3c-c4033e75daac tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 946 time: 0.0521233 Nov 18 21:16:20.545533 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-1ed9bd58-502b-4b7e-8c4e-2c7488ca484b service neutron] 10.222.0.62 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 200 len: 217 time: 0.0411997 Nov 18 21:16:20.565666 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [req-723611ac-fb45-4939-8c2f-966c737d9ab0 req-6595407e-2554-4154-8260-0ae9e2f6f69c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0460687 Nov 18 21:16:20.597440 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:20.601639 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-c26f6b10-8895-4284-b739-ab7d30dc4760 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:20.603167 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-c26f6b10-8895-4284-b739-ab7d30dc4760 service neutron] 10.222.0.62 "GET /v2.0/subnets?id=a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 200 len: 851 time: 0.0489519 Nov 18 21:16:20.656056 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-12104466-a237-47b8-b930-570ea5435f9e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:20.657536 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-12104466-a237-47b8-b930-570ea5435f9e service neutron] 10.222.0.62 "GET /v2.0/ports?network_id=e9895462-5764-4a81-a2a3-f5482f05a6a3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0459380 Nov 18 21:16:20.760040 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-a3c081bd-7928-430c-ba4f-aae186aa3344 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0910168 Nov 18 21:16:20.816550 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:20.844003 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af9a176c-9f2f-4050-b169-4592ee0e6b26 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:09:15Z', 'revision_number': 4, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi', '_interfaces': [{'id': 'e894597e-82db-4b86-bae6-f4e25e75c247', 'name': '', 'network_id': 'e9895462-5764-4a81-a2a3-f5482f05a6a3', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'mac_address': 'fa:16:3e:5b:8c:de', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_interface', 'standard_attr_id': 549, 'fixed_ips': [{'subnet_id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:14Z', 'updated_at': '2021-11-18T21:09:19Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'subnets': [{'id': 'a8ffc170-cfa2-4b16-935a-923d6b39dd63', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:16:20.884677 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-16ddbaf7-017f-4bf9-8244-ac28fac869ce req-6a25431e-2315-417b-96ff-001553259301 service neutron] 10.222.0.62 "GET /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1155019 Nov 18 21:16:21.077473 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-43285ffe-1c91-4d95-8810-b2c88b252e87 None None] New status for floating IP 0f861e62-8650-4c07-a7bd-9ba50c0ce97f: DOWN {{(pid=102672) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 18 21:16:21.696841 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ee64833-d03b-4797-8a39-19a0494ac0d7 req-aea634f4-f9e4-42c4-abd4-ad9dd1bb925a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:21.698413 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1ee64833-d03b-4797-8a39-19a0494ac0d7 req-aea634f4-f9e4-42c4-abd4-ad9dd1bb925a tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 946 time: 0.0535283 Nov 18 21:16:21.757885 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-1ee64833-d03b-4797-8a39-19a0494ac0d7 req-c22af68f-a24a-4db1-b5e5-5d7161d5881d tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/security-groups?id=05581fc3-f5ff-492a-8f7f-0d168cec3421&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531673 Nov 18 21:16:22.120453 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-782ef05b-710f-442a-b096-a2e2a1d200d6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=102669) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 18 21:16:22.121895 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-782ef05b-710f-442a-b096-a2e2a1d200d6 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 946 time: 0.0483880 Nov 18 21:16:22.216188 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Deleting port eb59c5f9-17de-415f-9154-1ff6f5903ba6 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:22.216521 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:22.304956 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] For port eb59c5f9-17de-415f-9154-1ff6f5903ba6, host hv-cinder-79987, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-79987',level=0,port_id=eb59c5f9-17de-415f-9154-1ff6f5903ba6,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:22.305310 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:22.318049 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Calling delete_port for eb59c5f9-17de-415f-9154-1ff6f5903ba6 owned by compute:nova {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:22.445505 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:22.479173 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'Port': ['ID=eb59c5f9-17de-415f-9154-1ff6f5903ba6,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:22.522194 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.l3_dvrscheduler_db [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] No DVR routers for this DVR port eb59c5f9-17de-415f-9154-1ff6f5903ba6 on host hv-cinder-79987 {{(pid=102669) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:16:22.526149 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for port, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:22.528227 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-317f443c-87bc-4202-85cc-52cad7f4abcf req-1a37f65c-1f47-4918-98ce-d83f5640549c tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.62 "DELETE /v2.0/ports/eb59c5f9-17de-415f-9154-1ff6f5903ba6 HTTP/1.1" status: 204 len: 173 time: 0.3993464 Nov 18 21:16:22.528689 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'name': 'network-vif-deleted', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6'}] {{(pid=102669) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 18 21:16:22.531494 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.61/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}f3179300898314e96239b62db661eac4e53f1ada725173af52c79d2242603ae4" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5eb0c2a5-9094-493a-ad92-f2450c0c5927" -d '{"events": [{"server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "name": "network-vif-deleted", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6"}]}' {{(pid=102669) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 18 21:16:22.571298 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Thu, 18 Nov 2021 21:16:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f72106e3-e054-40fb-9da0-9253565b6fde x-openstack-request-id: req-f72106e3-e054-40fb-9da0-9253565b6fde {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 18 21:16:22.571593 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5cd86f21-c27f-4d18-bf7a-e7e51c7120a9", "name": "network-vif-deleted", "tag": "eb59c5f9-17de-415f-9154-1ff6f5903ba6", "status": "completed", "code": 200}]} {{(pid=102669) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 18 21:16:22.571858 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.61/compute/v2.1/os-server-external-events used request id req-f72106e3-e054-40fb-9da0-9253565b6fde {{(pid=102669) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 18 21:16:22.572300 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5cd86f21-c27f-4d18-bf7a-e7e51c7120a9', 'name': 'network-vif-deleted', 'tag': 'eb59c5f9-17de-415f-9154-1ff6f5903ba6', 'status': 'completed', 'code': 200} Nov 18 21:16:22.885621 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [req-e0814829-82e5-4d7a-8fb2-d1ae29ed3d13 req-765ce483-76f1-427b-b12c-feaf0434e070 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "GET /v2.0/ports?device_id=5cd86f21-c27f-4d18-bf7a-e7e51c7120a9 HTTP/1.1" status: 200 len: 210 time: 0.0288415 Nov 18 21:16:23.943962 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 43994) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:24.069168 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Deleting port dd2b315a-acef-4657-8a9e-1ffb8f65f753 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:24.069504 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:24.147129 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:24.147446 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:24.159078 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Calling delete_port for dd2b315a-acef-4657-8a9e-1ffb8f65f753 owned by network:floatingip {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:24.291604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:24.315372 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'Port': ['ID=dd2b315a-acef-4657-8a9e-1ffb8f65f753,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:24.327247 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.327597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.327939 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.328300 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.328632 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.328970 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.329299 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.329626 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.329953 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.330277 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.330597 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.330916 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102670) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:24.387213 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for floatingip, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:24.389909 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-415909'] for floatingip, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:24.391201 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-b32f1daf-14ce-4b4e-ad1d-cbe5c4d3b8a9 tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "DELETE /v2.0/floatingips/4bf11b18-f117-4ce3-b18f-24d4f932b180 HTTP/1.1" status: 204 len: 168 time: 0.4459116 Nov 18 21:16:25.592893 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 44006) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:25.649940 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b8b4a8a5-a271-4094-a16f-1073f9a83a2f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:25.675510 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b8b4a8a5-a271-4094-a16f-1073f9a83a2f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:25.735614 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b8b4a8a5-a271-4094-a16f-1073f9a83a2f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:25.738334 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-b8b4a8a5-a271-4094-a16f-1073f9a83a2f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Publish callbacks [] for security_group, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:25.739517 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-b8b4a8a5-a271-4094-a16f-1073f9a83a2f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] 10.222.0.61 "DELETE /v2.0/security-groups/05581fc3-f5ff-492a-8f7f-0d168cec3421 HTTP/1.1" status: 204 len: 168 time: 0.1456480 Nov 18 21:16:25.749548 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b8b4a8a5-a271-4094-a16f-1073f9a83a2f tempest-TestVolumeBootPattern-462455779 tempest-TestVolumeBootPattern-462455779-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=05581fc3-f5ff-492a-8f7f-0d168cec3421,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:25.766445 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device eb59c5f9-17de-415f-9154-1ff6f5903ba6 no longer exists at agent hyperv_hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:25.791473 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] No Port match for: eb59c5f9-17de-415f-9154-1ff6f5903ba6 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:25.791833 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Device eb59c5f9-17de-415f-9154-1ff6f5903ba6 not bound to the agent host hv-cinder-79987 {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:25.799766 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44010) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:26.275145 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:26.517345 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Deleting port e894597e-82db-4b86-bae6-f4e25e75c247 {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:26.517595 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:26.600920 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] For port e894597e-82db-4b86-bae6-f4e25e75c247, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=e894597e-82db-4b86-bae6-f4e25e75c247,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:26.601270 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:26.613619 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Calling delete_port for e894597e-82db-4b86-bae6-f4e25e75c247 owned by network:router_interface {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:26.791368 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:26.820813 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Pushing event deleted for resources: {'Port': ['ID=e894597e-82db-4b86-bae6-f4e25e75c247,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:26.996931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:27.212801 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Router defd8ebd-2dda-4655-92d4-b940e401ee36 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102670) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:16:27.553079 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102670) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:16:27.558137 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-e85269d7-004d-4e03-a5ad-3c1ae371cdff admin admin] 10.222.0.61 "PUT /v2.0/routers/defd8ebd-2dda-4655-92d4-b940e401ee36/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.7572451 Nov 18 21:16:27.560604 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44014) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:27.563234 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] Sync routers for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:16:27.573708 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:27.574342 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:27.665402 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks [] for router, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:27.681744 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:27.765299 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:27.823461 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Deleting port 7bd26ebf-504e-4ae0-bc44-3985411446ff {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:27.824168 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:27.863445 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149'}], 'enable_snat': True}, 'gw_port_id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:16:26Z', 'revision_number': 5, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port': {'id': '7bd26ebf-504e-4ae0-bc44-3985411446ff', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:ad:d8:da', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'device_owner': 'network:router_gateway', 'standard_attr_id': 548, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.149', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:12Z', 'updated_at': '2021-11-18T21:09:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:27.889904 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] Checking router: defd8ebd-2dda-4655-92d4-b940e401ee36 for host: dv-cinder-799871-8-iscsi {{(pid=102671) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:16:27.898662 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] Routers {'defd8ebd-2dda-4655-92d4-b940e401ee36'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102671) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:27.899267 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['defd8ebd-2dda-4655-92d4-b940e401ee36'], 'active': True} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:27.903744 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] For port 7bd26ebf-504e-4ae0-bc44-3985411446ff, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=7bd26ebf-504e-4ae0-bc44-3985411446ff,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:27.904233 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:27.917601 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Calling delete_port for 7bd26ebf-504e-4ae0-bc44-3985411446ff owned by network:router_gateway {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:27.986467 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvr_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] Set router defd8ebd-2dda-4655-92d4-b940e401ee36 gateway port host: None {{(pid=102671) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:28.041524 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_hamode_db [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:16:27Z', 'revision_number': 6, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102671) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:28.067138 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-13ccc574-dba5-4d7b-861d-1e894a3d14f6 None None] The sync data for ids ['defd8ebd-2dda-4655-92d4-b940e401ee36'] in dv-cinder-799871-8-iscsi is: [{'id': 'defd8ebd-2dda-4655-92d4-b940e401ee36', 'name': 'tempest-TestVolumeBootPattern-1062322180-router', 'tenant_id': '97c605960c964eb3960a3f3324bf46bb', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:11Z', 'updated_at': '2021-11-18T21:16:27Z', 'revision_number': 6, 'project_id': '97c605960c964eb3960a3f3324bf46bb', 'gw_port_host': None}] {{(pid=102671) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:16:28.092424 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.115199 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Pushing event deleted for resources: {'Port': ['ID=7bd26ebf-504e-4ae0-bc44-3985411446ff,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:28.185023 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.278369 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.280487 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.323935 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.324481 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Fanout notify agent at l3_agent the message router_deleted on router defd8ebd-2dda-4655-92d4-b940e401ee36 {{(pid=102670) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:16:28.328895 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] Publish callbacks [] for router, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.330011 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-1ea8589e-072e-434e-82b7-c56d3f057a0c admin admin] 10.222.0.61 "DELETE /v2.0/routers/defd8ebd-2dda-4655-92d4-b940e401ee36 HTTP/1.1" status: 204 len: 168 time: 0.7685022 Nov 18 21:16:28.332652 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44016) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:28.381915 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.db_base_plugin_v2 [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Deleting subnet a8ffc170-cfa2-4b16-935a-923d6b39dd63 {{(pid=102670) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:16:28.384931 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.420438 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5811756'] for subnet, precommit_delete_associations {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.513967 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.569015 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5839959', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-6003678'] for subnet, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.596197 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a8ffc170-cfa2-4b16-935a-923d6b39dd63,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:28.598218 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for subnet, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.602469 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-59d3378e-93f4-4233-8e01-98e8e35656f0 admin admin] 10.222.0.61 "DELETE /v2.0/subnets/a8ffc170-cfa2-4b16-935a-923d6b39dd63 HTTP/1.1" status: 204 len: 168 time: 0.2688806 Nov 18 21:16:28.603644 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-37e3daea-fe88-4d9b-a467-f09a2b74cd4b None None] Network e9895462-5764-4a81-a2a3-f5482f05a6a3 requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:16:28.604945 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44018) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:28.672541 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.728720 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Deleting port c68a60d7-a31c-4853-9da3-a5dcc9c758af {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:28.729057 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.797092 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] For port c68a60d7-a31c-4853-9da3-a5dcc9c758af, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=c68a60d7-a31c-4853-9da3-a5dcc9c758af,segment=NetworkSegment(d8703035-b9e3-4e75-be30-8ad0a395f302),segment_id=d8703035-b9e3-4e75-be30-8ad0a395f302)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:28.797375 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.811034 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Calling delete_port for c68a60d7-a31c-4853-9da3-a5dcc9c758af owned by network:dhcp {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:28.857482 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] DHCP port deletion for e9895462-5764-4a81-a2a3-f5482f05a6a3 request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:16:28.894825 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.905544 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Deleting port c68a60d7-a31c-4853-9da3-a5dcc9c758af {{(pid=102671) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:28.905932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.922825 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Pushing event deleted for resources: {'Port': ['ID=c68a60d7-a31c-4853-9da3-a5dcc9c758af,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:28.924376 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] No DVR routers for this DVR port c68a60d7-a31c-4853-9da3-a5dcc9c758af on host dv-cinder-799871-8-iscsi {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:16:28.979775 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] For port c68a60d7-a31c-4853-9da3-a5dcc9c758af, host dv-cinder-799871-8-iscsi, got binding levels [] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:28.980193 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:28.992564 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Calling delete_port for c68a60d7-a31c-4853-9da3-a5dcc9c758af owned by network:dhcp {{(pid=102671) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:28.995216 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.ipam_backend_mixin [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Port c68a60d7-a31c-4853-9da3-a5dcc9c758af was not found and therefore no delete operation was performed {{(pid=102671) delete_port /opt/stack/neutron/neutron/db/ipam_backend_mixin.py:574}} Nov 18 21:16:28.996531 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583'] for port, after_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.000830 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.022292 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Pushing event deleted for resources: {'Port': ['ID=c68a60d7-a31c-4853-9da3-a5dcc9c758af,revision_number=None']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:29.022527 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['e9895462-5764-4a81-a2a3-f5482f05a6a3']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:29.024522 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] No DVR routers for this DVR port c68a60d7-a31c-4853-9da3-a5dcc9c758af on host dv-cinder-799871-8-iscsi {{(pid=102671) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:16:29.032496 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.032720 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.033027 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.033358 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.033683 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.034010 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.034825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.034825 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.035005 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.035730 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.035730 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.035922 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-92957abf-aa7e-4299-8a03-0ec7622ea489 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-799871-8-iscsi {{(pid=102671) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 18 21:16:29.039704 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'd8703035-b9e3-4e75-be30-8ad0a395f302') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:29.039880 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'd8703035-b9e3-4e75-be30-8ad0a395f302') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:29.049896 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.065106 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.073994 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Releasing vlan 639 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:16:29.074310 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:16:29.076208 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:16:29.137681 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.143586 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.147990 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] 10.222.0.61 "DELETE /v2.0/networks/e9895462-5764-4a81-a2a3-f5482f05a6a3 HTTP/1.1" status: 204 len: 168 time: 0.5420778 Nov 18 21:16:29.151023 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 44020) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:29.160797 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b153dab-45c1-4f22-9c9f-637d006157ba admin admin] Pushing event deleted for resources: {'Network': ['ID=e9895462-5764-4a81-a2a3-f5482f05a6a3,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:29.502184 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1015562'] for router_interface, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.752855 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Deleting port 141ed927-8ee9-4f96-9375-4e50e1de01e6 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:29.753110 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.833040 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] For port 141ed927-8ee9-4f96-9375-4e50e1de01e6, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=141ed927-8ee9-4f96-9375-4e50e1de01e6,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:29.833423 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:29.847539 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Calling delete_port for 141ed927-8ee9-4f96-9375-4e50e1de01e6 owned by network:router_interface {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:30.023225 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:30.056165 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Pushing event deleted for resources: {'Port': ['ID=141ed927-8ee9-4f96-9375-4e50e1de01e6,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:30.214369 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device e894597e-82db-4b86-bae6-f4e25e75c247 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:30.227418 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-635345', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1015734'] for router_interface, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:30.238733 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: e894597e-82db-4b86-bae6-f4e25e75c247 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:30.239084 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device e894597e-82db-4b86-bae6-f4e25e75c247 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:30.239513 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 7bd26ebf-504e-4ae0-bc44-3985411446ff no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:30.266279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 7bd26ebf-504e-4ae0-bc44-3985411446ff {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:30.266279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 7bd26ebf-504e-4ae0-bc44-3985411446ff not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:30.266279 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device c68a60d7-a31c-4853-9da3-a5dcc9c758af no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:30.283969 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: c68a60d7-a31c-4853-9da3-a5dcc9c758af {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:30.284273 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device c68a60d7-a31c-4853-9da3-a5dcc9c758af not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:30.445369 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 has already been hosted by L3 agent 5339c380-944d-4673-b07a-00a7ca3896f5 {{(pid=102669) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 18 21:16:30.552403 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] Notify agent at l3_agent.dv-cinder-799871-8-iscsi the message routers_updated {{(pid=102669) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 18 21:16:30.558147 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-4f7031a0-b8d0-4adc-a7d4-b2028decc6ad admin admin] 10.222.0.61 "PUT /v2.0/routers/8e7652c0-bf6b-4dfc-99eb-ed46cb070a41/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.4053624 Nov 18 21:16:30.560532 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 44022) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:30.567232 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] Sync routers for ids ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'] in dv-cinder-799871-8-iscsi {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 18 21:16:30.577391 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] Routers {'8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:30.577994 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:30.665438 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks [] for router, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:30.684306 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] Set router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 gateway port host: dv-cinder-799871-8-iscsi {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:30.766413 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:30.821504 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Deleting port dd06c76e-968c-4d35-89e1-317e3bf09ec0 {{(pid=102669) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:30.821825 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:30.867966 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'external_fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244'}], 'enable_snat': True}, 'gw_port_id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:16:29Z', 'revision_number': 5, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port': {'id': 'dd06c76e-968c-4d35-89e1-317e3bf09ec0', 'name': '', 'network_id': '3ccc1fc8-5b3a-4017-b404-0fb0c6ada1f2', 'tenant_id': '', 'mac_address': 'fa:16:3e:71:9d:48', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'device_owner': 'network:router_gateway', 'standard_attr_id': 560, 'fixed_ips': [{'subnet_id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'ip_address': '172.27.3.244', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-799871-8-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:09:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '3a94b01e-338e-4379-8e3f-ecc667769e62', 'cidr': '172.27.3.0/24', 'gateway_ip': '172.27.3.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-799871-8-iscsi'}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:30.893965 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] Checking router: 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 for host: dv-cinder-799871-8-iscsi {{(pid=102672) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 18 21:16:30.903589 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] Routers {'8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'} bound to L3 agent in host dv-cinder-799871-8-iscsi {{(pid=102672) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 18 21:16:30.904268 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-799871-8-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-18T20:53:05Z,description=,heartbeat_timestamp=2021-11-18T21:16:05Z,host='dv-cinder-799871-8-iscsi',id=5339c380-944d-4673-b07a-00a7ca3896f5,load=0,resource_versions=,resources_synced=,started_at=2021-11-18T20:53:05Z,topic='l3_agent')) {'router_ids': ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'], 'active': True} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:30.909018 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.db [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] For port dd06c76e-968c-4d35-89e1-317e3bf09ec0, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=dd06c76e-968c-4d35-89e1-317e3bf09ec0,segment=NetworkSegment(bc9325a4-1103-4504-96f0-c02c30f29de6),segment_id=bc9325a4-1103-4504-96f0-c02c30f29de6)] {{(pid=102669) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:30.909399 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:30.922726 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.plugins.ml2.plugin [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Calling delete_port for dd06c76e-968c-4d35-89e1-317e3bf09ec0 owned by network:router_gateway {{(pid=102669) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:30.989379 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_dvr_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] Set router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 gateway port host: None {{(pid=102672) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 18 21:16:31.043851 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.l3_hamode_db [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:16:30Z', 'revision_number': 6, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port_host': None}], 'dv-cinder-799871-8-iscsi', False) {} {{(pid=102672) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:31.092677 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5320446'] for port, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.121774 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Pushing event deleted for resources: {'Port': ['ID=dd06c76e-968c-4d35-89e1-317e3bf09ec0,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:31.158349 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b28bcca8-3999-4f48-93db-0576b6828388 None None] The sync data for ids ['8e7652c0-bf6b-4dfc-99eb-ed46cb070a41'] in dv-cinder-799871-8-iscsi is: [{'id': '8e7652c0-bf6b-4dfc-99eb-ed46cb070a41', 'name': 'tempest-TestVolumeBootPattern-343507265-router', 'tenant_id': 'd704a5aca34847afa350e7c00eaffb32', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-18T21:09:17Z', 'updated_at': '2021-11-18T21:16:30Z', 'revision_number': 6, 'project_id': 'd704a5aca34847afa350e7c00eaffb32', 'gw_port_host': None}] {{(pid=102672) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 18 21:16:31.186635 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1025484'] for router_gateway, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.281278 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1011872', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-27478'] for router, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.283402 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.325753 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1011881'] for router, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.326271 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 {{(pid=102669) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 18 21:16:31.330440 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] Publish callbacks [] for router, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.331644 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-03bd0b15-8003-459e-a8d1-9760f0c82934 admin admin] 10.222.0.61 "DELETE /v2.0/routers/8e7652c0-bf6b-4dfc-99eb-ed46cb070a41 HTTP/1.1" status: 204 len: 168 time: 0.7701612 Nov 18 21:16:31.334251 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.wsgi [-] (102669) accepted ('10.222.0.61', 44024) {{(pid=102669) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:31.382221 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.db.db_base_plugin_v2 [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Deleting subnet 5942750d-1edf-4991-961b-07e7165d1801 {{(pid=102669) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 18 21:16:31.385332 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Publish callbacks [] for subnet, before_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.419901 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-5774555'] for subnet, precommit_delete_associations {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.496708 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-1669763'] for subnet, precommit_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.553492 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-1669752', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-881257', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-5320397', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-5087295'] for subnet, after_delete {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.853537 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Pushing event deleted for resources: {'Subnet': ['ID=5942750d-1edf-4991-961b-07e7165d1801,revision_number=None']} {{(pid=102669) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:31.857272 dv-cinder-799871-8-iscsi neutron-server[102669]: DEBUG neutron_lib.callbacks.manager [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] Publish callbacks [] for subnet, before_response {{(pid=102669) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.860479 dv-cinder-799871-8-iscsi neutron-server[102669]: INFO neutron.wsgi [None req-789fd24e-f467-4c60-9c4c-9050f3a0115a admin admin] 10.222.0.61 "DELETE /v2.0/subnets/5942750d-1edf-4991-961b-07e7165d1801 HTTP/1.1" status: 204 len: 168 time: 0.5252957 Nov 18 21:16:31.864215 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44026) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:31.865456 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5de7731-f8cc-4bf7-93f2-13aa458a1aad None None] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f requested from dv-cinder-799871-8-iscsi {{(pid=102671) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 18 21:16:31.938056 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-1644445'] for network, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:31.991681 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Deleting port 8dd4eae7-d540-4139-93fa-78e99e88f03f {{(pid=102670) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:31.992035 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.048768 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] DHCP port deletion for 29171ce5-2b7b-472e-a1ff-f433c192f19f request from dv-cinder-799871-8-iscsi {{(pid=102671) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 18 21:16:32.063234 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.db [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] For port 8dd4eae7-d540-4139-93fa-78e99e88f03f, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8dd4eae7-d540-4139-93fa-78e99e88f03f,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102670) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:32.063630 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.077331 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.plugin [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Calling delete_port for 8dd4eae7-d540-4139-93fa-78e99e88f03f owned by network:dhcp {{(pid=102670) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:32.098059 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Deleting port 8dd4eae7-d540-4139-93fa-78e99e88f03f {{(pid=102671) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1936}} Nov 18 21:16:32.099229 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8748165428327'] for port, before_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.171103 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-5839972'] for port, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.171341 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8dd4eae7-d540-4139-93fa-78e99e88f03f no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:32.175764 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.db [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] For port 8dd4eae7-d540-4139-93fa-78e99e88f03f, host dv-cinder-799871-8-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-799871-8-iscsi',level=0,port_id=8dd4eae7-d540-4139-93fa-78e99e88f03f,segment=NetworkSegment(0e18f24a-fa22-4271-b748-71897099ca75),segment_id=0e18f24a-fa22-4271-b748-71897099ca75)] {{(pid=102671) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 18 21:16:32.176281 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1026957'] for port, precommit_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.202247 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Pushing event deleted for resources: {'Port': ['ID=8dd4eae7-d540-4139-93fa-78e99e88f03f,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:32.204024 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 8dd4eae7-d540-4139-93fa-78e99e88f03f {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:32.206945 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] No DVR routers for this DVR port 8dd4eae7-d540-4139-93fa-78e99e88f03f on host dv-cinder-799871-8-iscsi {{(pid=102670) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:16:32.207558 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 8dd4eae7-d540-4139-93fa-78e99e88f03f not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:32.208011 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 141ed927-8ee9-4f96-9375-4e50e1de01e6 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:32.234781 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Calling delete_port for 8dd4eae7-d540-4139-93fa-78e99e88f03f owned by network:dhcp {{(pid=102671) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2014}} Nov 18 21:16:32.242677 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: 141ed927-8ee9-4f96-9375-4e50e1de01e6 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:32.243027 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device 141ed927-8ee9-4f96-9375-4e50e1de01e6 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:32.243452 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device dd06c76e-968c-4d35-89e1-317e3bf09ec0 no longer exists at agent ovs-agent-dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 18 21:16:32.275095 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.plugin [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] No Port match for: dd06c76e-968c-4d35-89e1-317e3bf09ec0 {{(pid=102671) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2272}} Nov 18 21:16:32.275441 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.plugins.ml2.rpc [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Device dd06c76e-968c-4d35-89e1-317e3bf09ec0 not bound to the agent host dv-cinder-799871-8-iscsi {{(pid=102671) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 18 21:16:32.284015 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-1668372', 'neutron.services.segments.db._delete_segments_for_network-8748165504907'] for network, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.308087 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['29171ce5-2b7b-472e-a1ff-f433c192f19f']}} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:32.318494 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0e18f24a-fa22-4271-b748-71897099ca75') {'for_net_delete': True} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:32.318781 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.services.segments.db [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0e18f24a-fa22-4271-b748-71897099ca75') {} {{(pid=102670) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 18 21:16:32.329172 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8748165324683', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-5810655'] for segment, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.343430 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342'] for segment, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.350888 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Releasing vlan 615 on physical network physnet1 to pool {{(pid=102670) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 18 21:16:32.351468 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-1657342', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-5839929'] for segment, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: Traceback (most recent call last): Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: timer() Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: cb(*args, **kw) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: return func(*args, **kwargs) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: self._notify() Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: self.callback(batched_events) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: event.method(event) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: aggregate_uuid = self.p_client.list_aggregates( Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: return f(self, *a, **k) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._get(url).json() Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: return self.request(url, 'GET', **kwargs) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: base_url = self.get_endpoint(auth, allow=allow, Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 18 21:16:32.353309 dv-cinder-799871-8-iscsi neutron-server[102670]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 18 21:16:32.415432 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-1668365', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858664', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1014068'] for network, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.423173 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-635386'] for network, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.426778 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] 10.222.0.61 "DELETE /v2.0/networks/29171ce5-2b7b-472e-a1ff-f433c192f19f HTTP/1.1" status: 204 len: 168 time: 0.5615480 Nov 18 21:16:32.439577 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-2b6e06b5-7538-420e-a479-9b40f99f1a67 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.440206 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7c46740-0136-447f-8254-3c33a0cadc4b admin admin] Pushing event deleted for resources: {'Network': ['ID=29171ce5-2b7b-472e-a1ff-f433c192f19f,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:32.480149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-1678262', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-196952', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-635368', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8748165435073', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8748164977583'] for port, after_delete {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.503536 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Network 29171ce5-2b7b-472e-a1ff-f433c192f19f is not hosted by any dhcp agent {{(pid=102671) _notify_agents /opt/stack/neutron/neutron/api/rpc/agentnotifiers/dhcp_rpc_agent_api.py:225}} Nov 18 21:16:32.504024 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] No DVR routers for this DVR port 8dd4eae7-d540-4139-93fa-78e99e88f03f on host dv-cinder-799871-8-iscsi {{(pid=102671) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 18 21:16:32.505844 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8c8a019a-e8d1-417b-a5db-06f2464de8ae None None] Pushing event deleted for resources: {'Port': ['ID=8dd4eae7-d540-4139-93fa-78e99e88f03f,revision_number=None']} {{(pid=102671) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:32.547638 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44030) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:32.588263 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-991c1ae7-c19b-4f33-bea6-4001d30e38a6 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=97c605960c964eb3960a3f3324bf46bb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0392301 Nov 18 21:16:32.590723 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44032) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:32.638470 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-306e3d6e-7786-446f-80cc-44a4525ad004 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.659184 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-306e3d6e-7786-446f-80cc-44a4525ad004 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.709531 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-306e3d6e-7786-446f-80cc-44a4525ad004 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.712163 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-306e3d6e-7786-446f-80cc-44a4525ad004 admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:32.713308 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-306e3d6e-7786-446f-80cc-44a4525ad004 admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/dd3be6fd-26cc-4b90-8aae-cf6e954e5bb3 HTTP/1.1" status: 204 len: 168 time: 0.1216908 Nov 18 21:16:32.722629 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306e3d6e-7786-446f-80cc-44a4525ad004 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dd3be6fd-26cc-4b90-8aae-cf6e954e5bb3,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:33.020528 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44038) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:33.059812 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-a2a0ceb1-d853-4674-b78a-624a25b7eff8 admin admin] 10.222.0.61 "GET /v2.0/security-groups?tenant_id=d704a5aca34847afa350e7c00eaffb32&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0375919 Nov 18 21:16:33.062208 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [-] (102670) accepted ('10.222.0.61', 44040) {{(pid=102670) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:1004}} Nov 18 21:16:33.109611 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c1d06f7c-4fb2-48eb-ad22-166407a89ebd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:33.130092 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c1d06f7c-4fb2-48eb-ad22-166407a89ebd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:33.179915 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c1d06f7c-4fb2-48eb-ad22-166407a89ebd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-858751'] for security_group, after_delete {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:33.182490 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron_lib.callbacks.manager [None req-c1d06f7c-4fb2-48eb-ad22-166407a89ebd admin admin] Publish callbacks [] for security_group, before_response {{(pid=102670) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:33.183641 dv-cinder-799871-8-iscsi neutron-server[102670]: INFO neutron.wsgi [None req-c1d06f7c-4fb2-48eb-ad22-166407a89ebd admin admin] 10.222.0.61 "DELETE /v2.0/security-groups/56d4323a-4844-4eb2-aa8d-f9da5ba3d38d HTTP/1.1" status: 204 len: 168 time: 0.1205652 Nov 18 21:16:33.191191 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d06f7c-4fb2-48eb-ad22-166407a89ebd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=56d4323a-4844-4eb2-aa8d-f9da5ba3d38d,revision_number=None']} {{(pid=102670) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 18 21:16:34.663377 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8c1bdbcb-2f51-400d-93be-60d94457cfe0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:36.058575 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:37.514680 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:38.266388 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:49.448417 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:16:53.794092 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:17:02.230764 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-9870bd96-f37a-4733-97ab-bea67b7c2c87 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:04.668679 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-46146862-1c72-40e2-ba5b-1c7c5797e052 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:06.060512 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:07.520550 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:08.268617 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:19.468420 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:30.794605 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:17:32.232642 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8747c8c2-6e32-4899-a527-c64a4ed27630 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:34.670668 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-84fc876f-32c1-4584-b0da-f6e24f93e7d7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:36.064251 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:37.521715 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:38.271218 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:17:49.486701 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:02.237769 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-bbb52156-ffcd-41bb-911e-17ed07eba1a7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:04.672064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8052b89c-e8ad-4f6b-932b-e72346b984da None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:06.069741 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:07.525986 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:07.795152 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:18:08.274043 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:19.479461 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:32.240585 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b5986a9b-4db5-4b55-a19d-a31a191cf828 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:34.674324 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-dda5dffe-cfd7-4392-b291-f68e72ab99df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:36.069481 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:37.528717 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:38.275973 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:44.793824 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:18:49.464760 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:18:51.972201 dv-cinder-799871-8-iscsi neutron-server[102670]: DEBUG neutron.wsgi [req-1279ea2f-e602-4fdc-b83f-6eab3ba99cee req-359ab7b5-ce69-4dc3-9655-efd320d2cb0e service neutron] (102670) timed out ('10.222.0.62', 59551) {{(pid=102670) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:842}} Nov 18 21:19:02.244835 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-fb22c7b3-2810-4bfa-adc5-e29519fd60c0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:04.675232 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-df9461ee-c5e4-436b-99a5-bb6ca9bc931a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:06.071661 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:07.533168 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:08.278225 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:19.465080 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:21.793552 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:19:32.246932 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-ff188d5f-4c58-4d6b-a27f-665da2c1de86 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:34.676218 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-25a57efa-d7bc-44bb-8797-409d86944f12 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:36.074638 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:37.534091 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:38.280603 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:49.478442 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:19:58.794388 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:20:02.248656 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-2a13dc05-1eaf-4770-84ab-27bc201f678e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:04.677028 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-8f5bc391-ce55-4088-9d30-7fdd1315d1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:06.076668 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:07.541057 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:08.284232 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:19.480663 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:32.250780 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-7bc5c9f1-5697-4399-bad1-b0c7ceac752a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:34.679405 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-6c5a8b8b-37cf-4401-ad5a-990e34577808 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:35.794278 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:20:36.079669 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:37.541312 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:38.286688 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:20:49.488355 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:02.253674 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-e3eb60e5-81d3-4592-98e2-90a8e08b5114 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:04.682858 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-88d3d049-881f-43f9-9ac9-a986d26b6a9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:06.083064 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:07.544451 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:08.289499 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:12.796005 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 18 21:21:19.505149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:32.256321 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-84a0b217-8b52-437b-a534-145c7275660e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:34.684500 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-a1ef72df-d48e-49fb-8412-8023d26194bc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:36.086149 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-644e6f4e-19c8-4e05-89c2-b434ef114e69 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:37.546721 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-20a1a9d6-c2d7-43e8-89a3-56d945a5d649 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:38.294494 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-21303fba-3e7c-4e14-a333-3b35ddf53f59 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:49.501826 dv-cinder-799871-8-iscsi neutron-server[102671]: DEBUG neutron_lib.callbacks.manager [None req-b720edbf-804e-43b1-bc07-911ce44dcafd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8748165505392', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-2092820'] for agent, after_update {{(pid=102671) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 18 21:21:49.795821 dv-cinder-799871-8-iscsi neutron-server[102672]: DEBUG neutron.db.agents_db [None req-2e853f09-405f-4458-b619-8f4360c37910 None None] Agent healthcheck: found 6 active agents {{(pid=102672) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}